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Abstract 

One approach to confronting computational hardness is to try to understand the 
contribution of various parameters to the running time of algorithms and the 
complexity of computational tasks. Almost no computational tasks in real life 
are specified by their size alone. It is not hard to imagine that some parameters 
contribute more intractability than others and it seems reasonable to develop 
a theory of computational complexity which seeks to exploit this fact. Such a 
theory should be able to address the needs of practicioners in algorithmics. The 
last twenty years have seen the development of such a theory. This theory has a 
large number of successes in terms of a rich collection of algorithmic techniques 
both practical and theoretical, and a fine-grained intractability theory. Whilst 
the theory has been widely used in a number of areas of applications includ- 
ing computational biology, linguistics, VLSI design, learning theory and many 
others, knowledge of the area is highly varied. We hope that this article will 
show both the basic theory and point at the wide array of techniques available. 
Naturally the treatment is condensed, and the reader who wants more should 
go to the texts of Downey and Fellows [125j , Flum and Grohe |155j , Niedermeier 
|240| . and the upcoming undergraduate text Downey and Fellows |127j . 
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1. Introduction 



1.1. Preamble 

There is little question that the computer has caused a profound change in 
society. At our fingertips are devices that are performing billions of computa- 
tions a second, and the same is true of embedded devices in ali manner of things. 
In the same way that much of mathematics was developed to understand the 

physics of the world around us, developing mathematics to understand com- 

? 

putation is an imperative. It is little wonder that the famous P= NP question 
is one of the Clay Prize questions and is regarded by some as the single most 
important problem in mathematics. This question is one in complexity theory 
which seeks to understand the resources (such as time or space) needed for 
computation. 

The goal of this paper is to describe the methods and development of an area 
of complexity theory called parameterized complexity. This is a fìne-grained 
complexity analysis which is often more attuned to analyzing computational 
questions which arise in practice than traditional worst case analysis. The 
idea here is that if you are working in some computational science and wish to 
understand what is feasihle in your area, then perhaps this is the methodology 
you should know. 

As articulated by the first author in [116] , people working in the area tend 
to be a bit schizophrenic in that, even in computer science, paper reviews range 
from saying that "parameterized complexity is now well known so why are you 
including this introductory stuff?", to the other extreme where reviewers say 
that they have never heard about it. 

Whilst the use of parameterized complexity in applications has been grow- 
ing at a very fast rate, there stili remain significant groups who seem unaware 
of the techniques and ideas of the area. Everyone, apparently, is aware of NP- 
completeness and seems vaguely aware of randomized or approximation tech- 
niques. However, this seems not to be the case yet for parameterized complexity 
and/or algorithms. Moreover, it is certainly not the case that parameterized 
complexity has become part of the standard curriculum of theoretical computer 
science as something ali researchers in complexity should know. 

1.2. The issue 

In the first book on the subject by Downey and Fellows |125j . much is 
made of the issue "what is the role of complexity theory?". After the work 
of Alan Turing and others in the mid-20th century, we understand what it 
means for something to be computable. But for actual computations, it is 
not enough to know that the problem is computable in theory. If we need to 
compute something it is not good if the running time will be so large that no 
computer ever conceived will be able to run the computation in the life time of 
the universe. Hence, the goal is to understand what is feasihle. The point is 
that for any combinatoria! problem, we will deal with only a small finite fraction 
of the universe, so how do we quantify this notion of feasibility? Classically, 
this is achieved by identifying feasibility with polynomial-time computability. 
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When we first learn of this, many of us immediately think of polynomial 
like n^" and say "surely that is not feasible!". We tend to forget that, 
because of such intuitive objections, the originai suggestions tliat asymptotic 
analysis was a reasonable way to measure complexity and polynomial time 
was a reasonable measure of feasibility, were initially quite controversial. The 
reasons that the now centrai ideas of asymptotic polynomial time (P-time) 
and NP-completeness have survived the test of time are basically two. Firstly, 
the methodologies associated with polynomial-time and P-time reductions have 
proved to be readily amenable to mathematical analysis in most situations. In a 
word, P has good closure properties. It offers a readily negotiable mathematical 
currency. Secondly, and even more importantly, the ideas seem to work in 
practice: for "naturai" problems the universe seems kind in the sense that (at 
least historically) if a "naturai" computational problem is in P then usually 
we can find an algorithm having a polynomial running time with small degree 
and small constants. This last point, while seeming a religious, rather than a 
mathematical, statement, seems the key driving force behind the universal use 
of P as a classification tool for "naturai" problems. 

Even granting this, the use of things like NP-completeness is a very coarse 
tool. We are given some problem and show that it is NP-complete. What to 
do? As pointed out in Garey and Johnson |172j . this is only an initial foray. 
Ali such a result says is that our hope for an exact algorithm for the general 
problem which is feasible is likely in vain. 

The problem with the standard approach of showing NP-completeness is 
that it offers no methodology of seeking practical and feasible algorithms for 
more restricted versions of the problem which might be both relevant and fea- 
sible. As we will see, parameterized complexity seeks to have a conversation 
with the problem which enables us to do just that. 

1.3. The idea 

The idea behind parameterized complexity is that we should look more 
deeply into the actual structure of the problem in order to seek some kind of 
hidden feasibility. Classical complexity views a problem as an instance and a 
question. The running time is specified by the input's size. 

Question : When will the input of a problem coming from "real life" have no 
more structure than its size? 
Answei : Never! 



For real-world computations we always know more about the problem. The 
problem is planar, the problem has small width, the problem only concerns 
small values of the parameters. Cities are regular, objects people construct 
tend to be built in some comprehensible way from smaller ones constructed 
earlier, people's minds do not tend to work with more than a few alternations 
of quantifier^ etc. Thus, why not have a couiplexity theory which exploits 



^As anyone who has taught analysis will know! 
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these structural parameters? Why not have a complexity theory more fìne- 
tuned to actual applications? 

1.4- The contribution of this article 

Before we launch into examples and definitions, we make some remar ks 
about what this article offers. The area of parameterized complexity (as an 
explicit discipline) has been around for around 20 years. The group or re- 
searchers who have adopted the methodology most strongly are those (partic- 
ularly in Europe) who are working in applications. What has emerged is a 
very rich collection of distinctive positive techniques which should be known 
to researchers in computational applications in areas as diverse as linguistics, 
biology, cognition, physics, etc. The point here is that once you focus on a 
an extended "computational dialog" with the problem new techniques emerge 
around this. These techniques vary from simple (and practical) locai reduc- 
tion rules (for example Karsten Weihe's solution to the "Europe train station 
problem" [280]) to some which are highly theoretical and use some very deep 
mathematics (for example, the recent proof that topological embedding is fixed- 
parameter tractable by Grohe, Kawarabayashi, Marx, and Wollan [180J, which 
uses most of the structure theory of the Graph Minors project of Robertson 
and Seymour [2531 ). 

The second part of this article looks at these positive techniques system- 
atically, and we hope that the reader will find useful tools there. This area 
is stili rapidly developing, and there are many internai contests amongst the 
researchers to develop techniques to beat existing bounds. For further details, 
the reader can see the web site http : / /f pt . wikidot . com/ . 

The first part of the article is devoted to limitations. It is worth mention- 
ing that the area is concerned with tractability within polynomial time. Hence 
classical methods do not readily apply. The question is "how does the problem 
resides in polynomial time". To illustrate this, we begin with the basic moti- 
vating examples. 

Vertex COVEE0 

Instance: A graph G = {V,E). 

Parameter: A positive integer k. 

Question: Does G have a vertex cover of size < k? (A vertex cover of a graph 
G is a set 5 C V{G) such that for ali edges {x, y} of G, either x £ S or y £ S.) 

DoMiNATiNG Set 
Instance: A graph G. 
Parameter: A positive integer k. 

Question: Does G have a dominating set of size k? (A dominating set is a 



^Current practice in the area is often to write this as Para- Vertex Cover, or sometime 
p-fc- Vertex Cover, but this seems unnecessarily notationaL We will usually supress the 
aspect of the problem being regarded as a parameter, or even that the problem is considered 
as a parameterized one when the context is clear. We believe that this will aide the general 
readability of the paper. 
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set S C V{G) where, for each u £ ViG) — S there is a v £ S such that 
{u,v}eE{G).) 

Of course both of these problems (without the parameter) are famously NP- 
complete by the work of Karp [201j . With the parameter fìxed then both of 
the problems are in polynomial time simply by trying ah of the (^) subsets of 
size k where n is the number of vertices of the input graph G. What we now 
know is that there is an algorithm running in time 1.2738'= + 0(n) (see [68]) 
(i.e., linear time for a fixed k and with an additive component that is mildly 
exponential in k), whereas the only known algorithm for DOMINATING Set is to 
try ali possibilities. This takes time more or less n''. Moreover, we remark that 
the methods for solving Vertex Cover are simple reduction rules which are 
"industriai strength" in that they run extremely well in practice (e.g. |60 |I216| ). 
even for k beyond which would seem reasonable, like k = 2000. The reader 
might wonder: does this matter? Table[T]from the originai book |125j illustrates 
the difference between a running time of Q{n^^^) (that is, where exaustive 
search is necessary) and a running time of 2^n. The latter has been achieved 
for several naturai parameterized problems. (In fact, as we have seen above, 
the Constant 2'= can sometimes be significantly improved and its contribution 
can sometimes even be additive.) 





n = 50 


n = 100 


n = 150 


k = 2 


625 


2,500 


5,625 


k = 3 


15,625 


125,000 


421,875 


k = 5 


390,625 


6,250,000 


31,640,625 


k = 10 


1.9 X 10^^ 


9.8 X 10^"^ 


3.7 X 10^^ 


k = 20 


1.8 X 10^** 


9.5 X 10^^ 


2.1 X 10^^ 



Table 1: The Ratio ^rr. — for Various Values of n and k. 

Even before we give the formai definitions, the intent of the definitions 
will be clear. If we have algorithms running in time n'^, for some c that is 
independent of k, we regard this as being (fixed-parameter) tractable, and if 
c increases with k, then this problem is regarded as being intractable. In the 
latter case, we cannot usually prove intractability as it would separate P from 
NP, as it would in the case of Dominating Set, for example. But we can have 
a completeness programme in the same spirit as NP-completeness. 

We mention that the methodology has deep connections with classical com- 
plexity. For example, one of the more useful assumptions for establishing lower 
bounds in classical complexity is what is called the exponential time hypothesis 
(ETH) which is that not only is n-variable 3SAT not in polynomial time, but 
in fact it does not have an algorithm running in subexponential time. (Im- 
pagliazzo, Paturi and Zane |196j ). With this hypothesis, many lower bounds 
can be made rather sharp. Recently Chen and Grohe demonstrated an isomor- 
phism between subexponential time complexity and parameterized complexity 
|76j . The connection between subexponential time complexity and parameter- 
ized complexity was noticed long ago by Abrahamson, Downey and Fellows [2] . 
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Another notable connection is with polynomial time approximation schemes. 
Here the idea is to give a solution which is approximate to within e of the 
correct solution. Often the PCP theorem allows us to show that no such ap- 
proximation scheme exists unless P=NP. But sometimes they do, but can have 
awful running times. For example, here is a table from Downey |116j : 

• Arora (22] gave a O(n^) PTAS for Euclidean Tsp 

• Chekuri and Khanna [M] gave a 0(rii2(iog(i/£)/e8)^ p^^^g Multiple 
Knapsack 

1 

• Shamir and Tsur 12661 gave a 0(n2'' -1)) PTAS for Maximum Subfor- 

EST 

• Chen and Miranda [73] gave a 0(n(3'"'^')^'*'') PTAS for General Mul- 
TiPROCESSOR Job Scheduling 

• Erlebach et al. [I38] gave a 0(n-^^+^^'^^+^^') PTAS for Maximum 
Independent Set for geometrie graphs. 

Table [2] below calculates some running times for these PTAS's with a 20% 
error. 



Reference 


Running Time for a 20% Error 


Arora [22j 




Chekuri and Khanna [61j 


(^^^9,375,000^ 


Shamir and Tsur [266j 


(-)|-^958, 267,391^ 


Chen and Miranda [73j 






(4 Processors) 


Erlebach et al. p8j 


0(^523,804) 



Table 2: The Running Times for Some Recent PTAS's with 20% Error. 

Downey |116j argues as follows: 

"By anyone 's measure, a running time of n^^^'^^^ is bad and 7t,9'000,ooo 
is even worse. The optiniist would argue that these exaniples are 
iniportant in that they prove that PTAS's exist, and are but a first 
foray. The optimist would also argue that with more effort and 
better combinatorics, we will be able to come up with some n log n 
PTAS for the problems. For example, Arora also carne up with 
another PTAS for Euclidean Tsp, but this time it was nearly 
linear and practical. 

But this situation is akin to P vs NP. Why not argue that some 
exponential algorithm is just the first one and with more effort and 
better combinatorics we will find a feasible algorithm for Satisfia- 
bility? What if a lot of effort is spent in trying to find a practical 
PTAS's without success? As with P vs NP, what is desired is either 
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an efficienti^ PTAS (EPTAS), or a proofthat no such PTAS exist^ 
A primary use of NP-completeness is to give compelling evidence 
that many problems are unlikely to have hetter than exponential 
algorithms generateci hy complete search." 

The methods of parameterized complexity allow us to address the issue. 
Clearly, the bad running times are caused by the presence of ^ in the exponent. 
What we could do is parameterize the problem by taking the parameter to be 
k = and then perform a reduction to a kind of core problem (see Subsec- 
tion 3.5 ). If we can do this, then not only the particular algorithm is infeasible, 
but moreover, there cannot be a feasibie aigoritlim uniess sometiiing unliliely 
(alce a miniature P=NPj occurs. 

1.5. Other coping strategies 

Finally, before we move to formai definitions, we mention other strategies 
which attempt to understand what is feasibie. One that springs to mind is the 
theory of average-case complexity. This has not really been widely applied as 
the distributions seem rather difficult to apply. Similar comments apply to the 
theory of smoothed analysis. 

In fact one of the reasons that parameterized complexity has been used so 
often in practice is that it is widely applicable. We also mention that often it can 
be used to explain unexpected tractability of algorithms. Sometimes they seem 
to work because of underlying hidden parameters in the input. For example, 
the number of "lets" in some structured programming languages in practice is 
usually bounded by some Constant, and sometimes engineering considerations 
make sure that, for example, the number of wafers in VLSI design is small. It 
is even conceivable there might be a parametric explanation of the tractability 
of the Simplex Algorithm. 

If the reader finds this ali useful, then we refer him/her to two recent is- 
sues of the Tlie Computer Journal |128j devoted to aspects and applications of 
parameterized complexity, to the survey of Downey and McCartin [134] on pa- 
rameterized algorithms, the (somewhat dated) survey Downey |116j for issues 
in complexity, and other articles such as \126\ 11311 11321 ll4H - ll43j as well as the 
books by Downey and Fellows |125j . Niedermeier |240j and Flum and Grohe 

m- 

1.6. Organization and notation 

The paper is organized as foUows: 

In Section [2] we will give the basic definitions and some examples to show 
the kinds of parameterizations we can look at. We consider as fortunate the fact 
that a problem can have different parameterizations with different complexities. 

In Section [3j we will introduce some of the basic hardness classes, and in 
particular the main standard of hardness, the class W^[l]. The gold standard is 



^An Efficient Polynomial-Time Approximation Scheme (EPTAS) is an (1 + e)- 
approximation algorithm that runs in /(1/e) • n'^^^^ steps. If, additionally, / is a polynomial 
function then we say that we have a Fully Polynomial-Time Approximation Scheme (FPTAS). 

"^The same issue can also be raised if we consider FPTAS 's instead of EPTAS 's. 
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established by an analog of the Cook-Levin Theorem discusseci in Subsection 



3.2 Parameterized reductions are more refined than the corresponding classical 



ones, and, for instance, it would appear that naturai parameterized versions of 
3-CNF Sat and CNF Sat do not have the same parameterized complexity. In 
Subsection 3^ we see how this gives rise to a hierarchy based on logicai depth. 
We also mention the Flum-Grohe A[t] hierarchy which is another parameterized 
hierarchy of problems based on another measure of logicai depth. In Subsections 

approximation, and lower bounds based on 



3.5 and 3.6 we look at PTAS's, 



strong parameterized hypotheses. In Subection 3.7 we look at other applications 
to classical questions which are sensitive to combinatorics in polynomial time, 



and in Subsections 3.8 and 3.9 look at other parameterized classes such as 
counting classes and the notion of parameterized approximation. (The latter 
seeks, for example, an FPT-algorithm which on input k either delivers a "no size 
k dominating set" or produces one of size 2k.) Subsection 3.10 deals with an 
important recent development. One of the most important practical techniques 
kernelization. Here one takes a problem specified by (x, A;) G E* x N and 
produces, typically in polynomial time, a small version of the problem: (x', k') 
such that {x, k) is a yes iff (x', k') is a yes, and moreover < f{k) and usually 
k' < k. This technique is widely used in practice as it usually relies on a number 
of easily implementable reduction rules as we will discuss in Subsection 4.4 We 
will look at recent techniques which say when this technique can be used to give 
x' as above with \x'\ polynomially bounded. The final part of the complexity 
section deals with some of the other classes we have left out. 

In Section |4j we turn to techniques for the design of parameterized algo- 
rithms. We will focus mainly on graphs; for to lack of space we do not discuss 
too many applications, except en passant. 

The principal contributor of high running times in classical algorithms comes 
from branching, and large search trees. For this reason we begin by looking 
at methods which restrict the branching in Subection 4.1, including bounded 
search trees and greedy localization. Then in Subection 4.1.3 we look at the 
use of automata and logie in the design of parameterized algorithms. 

In turn this leads to meta-theoretical methods such as applications of Cour- 
celle's theorem on graphs of bounded treewidth, and other methods such as 
locai treewidth and First Order Logic (FOL). This is discussed in Subection 
11:211 and 14X21 

In Subections 4.2.3 and 4.2.4 we look at the highly impractical, but powerful 
methods emerging from the Graph Minors project. Later, we examine how these 
methods can be sped up. 

Having worked in the stratosphere of algorithm design we return to focus on 
singly-exponential algorithm design techniques such as iterative compression, 
bidimensionality theory, and then in Subsection 4.4 move to kernelization, and 
finish with variations. 

Of course, often we will use ali of this in combination. For example, we might 
kernelize, then begin a branch tree of some bounded size, and the rekernelize 
the smaller graphs. It is often the case that this method is provably faster and 
certainly this is how it it is often done in practice. However, we do not have 
space in this already long paper to discuss such refinements in more detail. 



2. Preliminaries 

2.1. Basic definitions 

The first thing to do is to defìne a proper notion of tractability for param- 
eterized problems. This induces the definition of the parametrized complexity 
class FPT, namely the class of fìxed-parameter tractable problems. 

Definition 2.1. A parameterized problem (also called parameterized language) 
is a subset II of S* x N where S is some alphabet. In the input (/, fc) G S* x N 

of a parameterized problem, we cali / as the mairi pari of the input and k as 
the parameter of the input. We also agree that n = | (I, A;) | . We say that II is 
fìxed parameter tractable if there exists a function / : N — >■ N and an algorithm 
deciding whether (7, A;) G II in 

Oifik) ■ n^) 

steps, where c is a Constant not depending on the parameter k of the problem. 
We cali such an algorithm fPT -algorithm or, more concretely, to visualize the 
choice of / and c, we say that II G 0{f{k) •n'^)-FPT. We define the parameterized 
class FPT as the one containing ali parameterized problems that can be solved 
by an FPT-algorithm. 

Observe that an apparently more demanding definition of an FPT-algoritm 

would ask for algorithms runnning in 0{f{k) + n'^) steps, since thcn the expo- 
nential part would be additive rather than multiplicative. However, this would 
not define a different parameterized complexity class. To see this, suppose that 
some parameterized problem II C S x N can be solved by an algorithm A that 
can decide whether some (/, k) belongs in II in f{k) ■n'^ steps. In case f{k) < n, 
the same algorithm requires n'^'^^ steps, while if n < f{k), the algorithm runs 
in less than (/(A;))'^+^ steps. In both cases, A solves II in at most g{k) + rf 
steps where gik) = {f{k)Y'^^ and c' = c + 1. 

Time bounds for parameterized algorithms have two parts. The f{k) is 
called parameter dependence and, is typically a super-polynomial function. The 
n'^ is a polynomial function and we will cali it polynomial part. While in classic 
algorithm design there is only polynomial part to improve, in FPT-algorithms it 
appears to be more important to improve the parameter dependence. Clearly, 
for practical purposes, an 0{f{k) + n^) step FPT-algorithm is more welcome 
than one running in 0{f(k) ■ n^) steps. 

2.2. Nom,enclature of parameterized problems 

Notice that a problem of classic complexity whose input has several inte- 
gers has several parameterizations depending on which one is chosen to be the 
parameter. We complement the name of a parameterized problem so to indi- 
cate the paramctcrization that we choose. In many cases, the parameterization 
refers to a property of the input. As a driving example we consider the foUowing 
problem: 



10 



DoMiNATiNG Set 

Instance: a graph G and an integer k 

Question: does G have a dominating set of size at most k? 

DOMINATING Set has several parameterizations. The most popular one is the 
fonowing one: 

fc-DoMiNATiNG Set 

Instance: a graph G and an integer k. 

Parameter: k. 

Question: does G have a dominating set of size at most k? 

Moreover, one can define parameterizations that do not depend on integers 
appearing exphcitly in the input of the problem. For this, one may set up a 
"promise" variant of the problem based on a suitable restriction of its inputs. 
That way, we may define the fohowing parameterization of Dominating Set: 

d-DoMiNATiNG Set 

Instance: a graph G with maximum degree d and an integer k. 
Parameter: d. 

Question: does G have a dominating set of size at most k? 

In the above problem the promise-restriction is "with maximum degree d" . In 
general, we often omit this restriction as it is becomes clear by the chosen pa- 
rameterization. Finally, we stress that we can define the parameterization by 
combining a promise restriction with parameters that appear in the input. As 
an example, we can define the following parameterization of Dominating Set: 

d-fc-DoMiNATiNG Set 

Instance: a graph G with maximum degree d and an integer k. 
Parameter: d + k. 

Question: does G have a dominating set of size at most kl 

Finally, the promise-restriction can be just a property of the main part of 
the input. A typical example is the following parameterized problem. 

/c-Planar Dominating Set 

Instance: a planar graph G and an integer k. 

Parameter: k. 

Question: does G have a dominating set of size at most kl 



Certainly, different parameterizations may belong to different parameterized 
complexity classes. For instance, (i-fc-DOMiNATiNG Set belongs to 0{{d+ 1)^ ■ 
FPT, using the bounded search tree method presented in Subsection 4.1. Il 



n 



Also, as we will see in Subsection |4.3.3[ /c-Planar Dominating Set belongs 
to 2'^(^) • n*^(^)-FPT. On the other side, d-DOMiNATiNG Set ^ FPT, un- 
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less P = NP. This follows by the well known fact that Dominating Set is 
NP-complete for graphs of maximum degree 3 and therefore, not even an n^^'^^- 
algorithm is expected to exist for this problem. The parameterized complexity 
of A;-DOMiNATlNG Set needs the definition of the W-hierarchy (defined in Sub- 
section 3.3). While the problem can be solved in 0{n^'^^) steps, it is known 



to be complete for the second level of the W-hierarchy. This indicates that an 
FPT-algorithm is unlikely to exist for this parameterization. 



3. Parameterized complexity 
3.1. Basics 

In this section we will look at some basic methods of establishing apparent 
parameterized intractability. We begin with the class W[l] and the W-hierarchy, 
and later look at variations, including the A and M hierarchies, connections with 
approximation, bounds on kernelization and the like. 

The role of the theory of NP-completeness is to give some kind of outer 
boundary for tractability. That is, if we identify P with "feasible", then showing 
that a problem is NP-complete would suggest that the problem is computation- 
ally intractable. Moreover, we would believe that a deterministic algorithm for 
the problem would require worst-case exponential time. 

However, showing that some problem is in P does not say that the problem 
is feasible. Good examples are the standard parameterizations of Dominating 
Set or Independent Set for which we know of no algorithm significantly 
better than trying ali possibilities. For a fixed k, trying ali possibilities takes 
time Q{n^~^^), which is infeasible for large n and reasonable k, in spite of the 
fact that the problem is in P. Of course, we would like to prove that there 
is no FPT algorithm for such a problem, but, as with classical complexity, the 
best we can do is to formulate some sort of completeness/hardness program. 
Showing that /c-DOMiNATiNG Set is not in FPT would also show, as a coroUary, 
that P / NP. 

A hardness program needs three things. First, it needs a notion of easiness, 
which we have: FPT. Second, it needs a notion of reduction, and third, it needs 
some core problem which we believe to be intractable. 

Following naturally from the concept of fixed-parameter tractability is an 
appropriate notion of reducibility that expresses the fact that two parameterized 
problems have comparable parameterized complexity. That is, if problem (lan- 
guage) A reduces to problem (language) B, and problem B is fixed-parameter 
tractable, then so too is problem A. 

Definition 3.1 (Downey and Fellows |122| Il 23] -Parameterized reduction). A 
parameterized reductioi^ from a parameterized language L to a parameterized 
language L' (symbolically L <fpt L') is an algorithm that computes, from 
input consisting of a pair (/, A;), a pair (/', k') such that: 



^Strictly speaking, this is a parameterized many-one reduction as an analog of the classical 
Karp reduction. Other variations such as parameterized Turing reductions are possible. The 
function g can be arbitrary, rather than computable, for other non-uniform versions. We give 
the reduction most commonly met. 
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1. {I,k) £ L if and only if (/', k') G L' , 

2. k' = g{k) is a computable function depending only k, and 

3. the computation is accomplished in time f{k)-rf, where n is the size of the 
main part of the input /, k is the parameter, c is a Constant (independent 
of both n and fc), and / is an arbitrary function dependent only on k. 

FPT B and B <fpt then we say that A and B are fPT -equivalent , 
and write A =fpt B. 

A simple example of an FPT reduction is the fact that A;-Independent 
Set =fpt /c-Clique. (Henceforth, we will usually drop the parameter k from 
the name of problems and will do so when the parameter is implicit from the 
context.) Namely, G has a clique of size k iff the complement of G has an 
independent set of size k. A simple non- example is the classical reduction of 
Independent Set to Vertex Cover: G will have a size k independent set 
iff G has a size n — k vertex cover, where n is the number of vertices of G. The 
point of this last example is that the parameter is not fixed. 

3.2. An analog of the Cook-Levin Theorem 

We need the final component for our program to establish the apparent 
parameterized intractability of computational problems: the Identification of a 
"core" problem to reduce from. 

In classical NP-completeness this is the heart of the Cook-Levin Theorem: 
the argument that a nondeterministic Turing machine is such an opaque object 
that it does not seem reasonable that we can determine in polynomial time if 
it has an accepting path from amongst the exponentially many possible paths. 
Building on earlier work of Abrahamson, Ellis, Fellows and Mata [1|, the idea of 
Downey and Fellows was to define reductions and certain core problems which 
have this property. In the fundamental papers jl22l I123j . a parameterized 
version of Circuit Acceptance. The classic version of this problem has as 
instance a boolean circuit and the question is whether some value assignment to 
the input variables leads to a yes. As is well known, this corresponds to Turing 
Machine acceptance, at least classically. Downey and Fellows |123j combined 
with Cai, Chen, Downey and Fellows [50] allows for a Turing Machine core 
problem: 

Short Non-Deterministic Turino Machine Acceptance 

Instance: A nondeterministic Turing machine M (of arbitrary degree of non- 

determinism) . 

Parameter: A positive integer k. 

Question: Does M have a computation path accepting the empty string in at 
most k steps? 

In the same sense that NP-completeness of the (?(n)-STEP Non-deterministic 
Turino Machine Acceptance, where q{n) is a polynomial in the size of the 
input, provides us with very strong evidence that no NP-complete problem is 
likely to be solvable in polynomial time, using Short Non-Deterministic 
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Turino Machine Acceptance as a hardness core provides us with very 
strong evidence that no parameterized language L, for which Short Non- 
Deterministio Turino Machine Aooeptanoe<fpt L, is likely to be fixed- 
parameter tractable. That is, if we accept the idea behind the basis of NP- 
completeness, then we should also accept that the Short Non-deterministic 
Turino Machine Acceptance problem is not solvable in time 0{\M\'^) for 
some fixed c. Our intuition would again be that ali computation paths would 
need to be tried. 

We remark that the hypothesis "Short Non-Deterministio Turino Ma- 
chine Acceptance is not in FPT" is somewhat stronger than P/NP. Fur- 
thermore, connections between this hypothesis and classical complexity have 
recently become apparent. If Short Non-Deterministio Turino Machine 
Acceptance is in FPT, then we know that the Exponential Time Hy- 
pothesis, which states that n-variable 3Sat is not in subexponential time 
(DTIME(2°("))), fails. See Impaghazzo, Paturi and Zane [M], Cai and Juedes 
|54j . and Estivill-Castro, Downey, Fellows, Prieto-Rodriguez and Rosamond 
|119 j (and our later discussion of M[l]) for more details. As we will later see the 
ETH is a bit stronger than the hypothesis that Short Non-Deterministic 
Turino Machine Acceptance is not in FPT, but is equivalent to an appar- 
ently stronger hypothesis that 7^ FPT". The precise definition of M[l] 

will be given later, but the idea here is that, as most researchers believe, not 
only is NP / P, but NP problems like Non-Deterministio Turino Machine 
Acceptance require substantial search of the available search space, and hence 
do not have algorithms running in deterministic subexponential time such as 
0(ni°g"). 

The class of problems that are FPT-reducible to Short Non-Deterministic 
Turino Machine Acceptance is called W[l], for reasons discussed below. 
The parameterized analog of the classical Cook-Levin theorem (that CNF Sat 
is NP-complete) uses the following parameterized version of 3Sat: 

Weighted CNF Sat 

Instance: A CNF formula X (i.e., a formula in Conjunctive Normal Form). 
Parameter: A positive integer k. 

Question: Does X have a satisfying assignment of weight k? 

Here the weight of an assignment is its Hamming weight, that is, the number 
of variables set to be true. 

Similarly, we can define Weighted nCNF Sat, where the clauses have 
only n variables and n is some number fixed in advance. Weighted nCNF 
Sat, for any fixed n > 2, is complete for V\/[l]. 

Theorem 3.2 (Downey and Fellows [123J and Cai, Chen, Downey and Fel- 
lows [50]). For any fixed n > 2, WEIGHTED nCNF Sat=fpt Short Non- 
Deterministio Turino Machine Acceptance. 

As we will see, there are many well-known problems hard for W[l]. For 
example, Clique and Independent set are basic W[l]-complete problems. 
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An example of a W[l]-hard problem Subset Sum which classically has as input 
a set S of integers, a positive integers and an integer s and asks if there is a set of 
members of S which add to s. In parametric forni, the question asks where there 
exist k members of S which add to s. A similar problem is EXACT Cheap Tour 
which asks for a weighted graph whether there is a tour through k nodes of total 
weight s. Another example is the Finite State Automata Intersection 
which has parameters m and k and asks for a set {Ai, . . . , Ai^} of finite state 
automata over an alphabet S whether there is a string X of length m accepted 
by each of the Ai, for i = 1,. . . ,k. There are a number of problems related 
to the Least Common Subsequence which are hard according to various 
parameterizations, and notably a W[l]-hard parameterized version of Steiner 
Tree. Here, and later, we will refer the reader to the various monographs and 
compendia such as the one currently maintained by Marco Cesati: 

[http : / /bravo . ce . uiiiroma2 . it/home/ cesati/research/ compendium/ 



The originai proof of Theorem 3.2 involves a generic simulation of a Turing 
machine by a circuit and then in the other direction involves combinatorial 
arguments to have parametric reductions from certain kinds of circuits ("weft 
1", see below) to Independent Set. 

Since the originai Downey-Fellows work, hundreds of problems have been 
shown to be W[l]-hard or W[l]-complete. A classical graph theoretical problem 
which is W[l]-complete (see |123| 1125] ) is the following. 

d-RED-BLUE NONBLOCKER 

Instance: A 2-coloured graph (VRedUVeiMe; E) of (fixed) maximum degree d> 2, 
and a positive integer k. 
Parameter: A positive integer k. 

Question: Is there a set of red vertices V C Vned of cardinality k such that 
each blue vertex has at least one neighbour not belonging to V'I. 

This problem seems to be useful for proving hardness results such as the 
proof that various coding problems are hard for V\/[l] in Downey, Fellows, Vardy, 
and Whittle |133j . In that problem, using a reduction from Red- Blue Non- 
BLOCKER Downey et. al. show the following naturai problem is hard for W[l]. 

Weight Distribution 

Instance: A binary m x n matrix H. 

Parameter: An integer A; > 0. 

Question: Is there a set of at most k columns of H that add to the ali zero 
vector? 

As a consequence, the related problem of Maximum Likelihood Decod- 
ing where there is a target vector s is also W[l] hard. Two notorious open 
questions remain in this area. 

Shortest Vector 

Instance: A basis X = {xi, . . . , x„} G Z" for a lattice L. 
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Parameter: An integer k > 0. 

Question: Is there a nonzero vector x G L such that < k7 

EvEN Set (also known as Minimum Distance) 
Instance: A red/blue graph G = {R, B, E). 
Parameter: A positive integer k. 

Question: Is there a set of at most A; > red vertices ali of which have an even 
number of blue neighbours? 

Both of these are conjectured in |125j as being W[l] hard. The unparam- 
eterized version of the latter is known to be NP-complete and of the former 
is famously open, a question of Peter van Emde Boas from 1980. We refer 
the reader to jl33j for more details and other related problems such as Theta 
Series. 

3.3. The \N-hierarchy 

The originai theorems and hardness classes were first characterized in terms 
of boolean circuits of a certain structure. These characterizations lend them- 
selves to easier membership proofs, as we now see. This uses the model of a 
decision circuii. This has boolean variables as inputs, and a single output. 
It has and and or gates and inverters. We designate a gate as large or small 
depending on the fan-in allowed, where small will be some fixed number. For 
example a 3CNF formula can be modeled by a circuit consisting of n input vari- 
ables (of unbounded fanout) one for each formula variable, possibly inverters 
below the variable, and a large and of small or's (of size 3) with a single output 
line. For a decision circuit, the depth is the maximum number of gates on any 
path from the input variables to the output line, and the weft is the "large- gate 
depth" . More precisely, the weft is defined to be the maximum number of large 
gates on any path from the input variables to the output line, where a gate is 
called large if its fan-in exceeds some pre-determined bound. 

The weight of an assignment to the input variables of a decision circuit is the 
Hamming weight, i.e., the number of variables set to true by the assignment. 

Let T = {Ci, . . . ,Cn, ■ . ■} be a family of decision circuits. Associated with 
is a basic parameterized language 

Ljr = {{Ci, k) : Ci has a weight k satisfying assignment} . 

We will denote by Lj^i^^^j^^ the parameterized language associated with the 
family of weft t, depth h, decision circuits. 

Defìnition 3.3 (W[t] - Downey and Fellows [121]). We define a language L 
to be in the class \N[t],t > 1 if there is a parameterized reduction from L to 
Lj^{t,h) , for some h. 

We think of the inputs of Weighted CNF Sat as circuits consisting of 
conjunctions of disjunctions of literals. Hence Weighted CNF Sat is in W[2]. 
Extending this idea, a typical example of a formula in W[3] would be a conjunc- 
tion of disjunctions of conjunctions of literals. More generally, we can define 
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Weighted t-NORMALiZED Sat as the weighted satisfiability problem for a for- 
mula X where X \s a conjunction of disjunctions of conjunctions of disjunctions 
. . . with t alternations. 

This allows for the fonowing basic result. 

Theorem 3.4 (Downey and Fehows |122j ). For ali t > l, Weighted t- 
NORMALIZED Sat ìs complete for \N[t]. 

There are problems complete for other W[t] levels such as Dominating 
Set being complete for W[2], but as with many situations in logie and com- 
puter science, naturai problems at levels above 3 tend to be rare. Cesati [57] 
gave machine-based problems for various levels and his approach (via Turing 
machines) can allow for easier proofs, such as his proof of the W[l]-completeness 
of Perfegt Code ([56]). 

As an illustrative example, we will give one of the basic reductions. 

Theorem 3.5 (Downey and Fellows |122j ). Dominating Set =fpt Weighted 
CNF Sat. 

Proof. We sketch the proof of the hardness direction that Weighted CNF 
Sat <fpt Dominating Set. 

Let X be a Boolean expression in conjunctive normal form consisting of 
m clauses Ci, ...,Cm over the set of n variables xq, ...,Xn-i- We show how to 
produce in polynomial-time by locai replacement, a graph G = {V, E) that has 
a dominating set of size 2k if and only if X is satisfied by a truth assignment 
of weight k. 

A diagram of the gadget used in the reduction is given in Figure [T] The 
idea of the proof is as follows. There are k of the gadgets arranged in a circle, 
where we regard them as ordered from first to last. Each of the gadgets has 
3 main parts. Taken clockwise from top to bottom, these are the truth setting 
clique, the gap selection part (achieved by the gap selection cliques) and the 
gap enforcement part (achieved by the gap enforcement line). 

The pigeonhole principle combined with the so-called enforcers are used to 
force one vertex from each of the truth cliques and one vertex from each of 
the next set of cliques, which form the gap enforcement part. The intuition 
is that the truth selection cliques represent a choice of a particular vertex to 
be selected to be true, and the gap selection represents the gap till the next 
selected true vertex. The interconnections between the truth setting cliques and 
the gap selection means that they align, and the gap enforcement line makes 
ali the selections consistent. Finally because of the clause variables which also 
need to be dominated, we will ensure that the dominating set corresponds to a 
truth assignment. 

In more detail, the truth selection component is a clique and the gap selec- 
tion consists of n cliques which we cali columns. Our first action is to ensure 
that in any dominating set of 2k elements, we must pick one vertex from each of 
these two components. This goal is achieved by the 2k sets of 2A; + 1 enforcers 
(which are independent sets). For example, for each truth selection clique, 2k+l 
enforcers are connected to every vertex in this clique and nowhere else and then 
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Figure 1: Gadget for DOMINATING Set 



it will follow by the pigeonholc principle that in any size 2k dominating set for 
the final graph, to dominate these enforeers, some vertex in the truth sclcetion 
chque must be chosen. Similarly, it fohows that we must pick exactly one vertex 
from each of the truth selection chques, and one of the gap selection cUques to 
dominate the enforeers. 

The truth selection component of the r-th gadget is denoted by A{r), r = 
0, . . . , fc — 1. Each of these k components consists of a clique of n vertices 
labeled 0, . . . ,n — 1. The intention is that if the vertex labeled i is picked, 
this represents variable i being set to true in the formula X. We denote by 
B{r) the gap selection part of the r-th gadget, r = 0, . . . , A; — 1. As explained 
above, this part consists of n columns (cliques) where we index the columns 
by z = 0, . . . , n — 1. The intention is that column i corresponds to the choice 
of variable i in the preceding A{r). The idea then is the following. We join 
the vertex a[r,i] corresponding to variable i, in A{r), to ali vertices in B{r) 
except those in column i. This means that the choice of i in A(r) will cover ali 
vertices of B{r) except those in this column. It foUows since we have only 2k 
to spend, that we must choose the dominating element from this column and 
nowhere else. (There are no connections from column to column.) The columns 
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are meant to be the gap selection saying how many O's there will be till the 
next positive choice for a variable. We finany need to ensure that if we choose 
variable i in A{r) and gap j in column i from B{r) then we need to pick + 1 
in A{r + 1). This is fulfilled by the gap enforcement component which consists 
of a set of n vertices. We denote by (i[r, s], s = 0, . . . , n — 1 the set of vertices 
in this gap-enforcement Une in the r-th gadget r = 0, . . . ,k — 1. 

For r < k — 1, the method is to connect vertex j in column i of i?(r) to ali 
of the n vertices d[r, s] except to d[r, + provided that i + j + 1 < n. (For 
r = k — 1 simply connect vertex j in column i of B{r) to ali of the n vertices 
d[r,s] except to d[r,i + j + 1] since this will need to "wrap around" to ^(0).) 
The first point of this process is that if we choose vertex j in column i with 
i+j + 1 > n then none of the vertices in the enforcement line are dominated. 
Since there is only a single edge to the corresponding vertex in A{r + 1), there 
cannot possibly be a size 2k dominating set for such a choice. It follows that 
we must choose some j with i + j + 1 < n in any dominating set of size < 2k. 
The main point is that if we choose j in column i we will dominate ali of the 
d[r,s] except d[r,i + j + 1]. Since we will only connect d[r,s] additionally to 
a[r + 1, s] and nowhere else, to choose an element of A[r + 1] and stili dominate 
ali of the d[r, s] we must actually choose a[r + l,i + j + 1]. 

Thus the above provides a selection gadget that chooses k true variables 
with the gaps representing false ones. We enforce that the selection is consis- 
tent with the clauses of X via clause vertices Ci one for each clause Cj. These 
are connected in the obvious ways. One connects a choice in A[r] or B[r\ corre- 
sponding to making a clause Cq true to the vertex Cq. Then if we dominate ali 
the clause variables too, we must have either chosen in some A[r\ a positive oc- 
currence of a variable in Cq or we must have chosen in B[r\ a gap corresponding 
to a negative occurrence of a variable in Cq, and conversely. The formai details 
can be found in Downey and Fellows |122| I125j . □ 

There are notable problems which are W[t]-hard for ali t, such as Band- 
WIDTH, below. 



Bandwidth 

Instance: A graph G = {V, E). 
Parameter: A positive integer k. 
Questioni Is there a 1-1 layout / : V 
implies \f{u) — f{v)\ < k? 



{1,...,\V\} such that {u,v} G E 



The W[t] (for ali t) hardness of Bandwidth was proven by Bodlaender, 
Fellows and Hallett [36] via a rather complex reduction. It is unknown what, 
say, Bandwidth G VV[1] (or even W[P]) would imply either parametrically or 
classically. On general grounds, it seems unlikely that such a containment is 
possible. 

At even higher levels, we can define Weighted Sat to be the weighted 
satisfiability problem where inputs correspond to unrestricted Boolean formulas 
and finally Weighted Cirguit Sat to be the most general problem whose 
inputs are ali polynomial sized circuits. 
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Notice that, in Theorem |3.2[ we did not say that Weighted CNF Sax is 
W[l]-complete. The reason for this is that we do not beheve that it is! In fact, 
we beheve that W[2] 7^ W[l]. 

That is, classically, using a padding argument, we know that CNF Sat =^ 
3CNF Sat. However, the classical reduction does not define a parameterized 
reduction from Weighted CNF Sat to Weighted 3CNF Sat, it is not 
structure-preserving enough to ensure that parameters map to parameters. In 
fact, it is conjectured [122] that there is no parameterized reduction at ah from 
Weighted CNF Sat to Weighted 3CNF Sat. If the conjecture is correct, 
then Weighted CNF Sat is not in the class W[l]. 

The point here is that parameterized reductions are more refined than clas- 
sical ones, and hence we believe that we get a wider variety of apparent hardness 
behaviour when intractable problems are classified according to this more fine- 
grained analysis. 

These classes form part of the basic hierarchy of parameterized problems 
below. 

FPT C W[l] C W[2] C . . . C \N[t] C \N[SAT] C W[P] C AW[t] c AW[P] C XP 

This sequence is commonly termed "the \N -hierarchì/^ . The complexity class 
W[l] can be viewed as the parameterized analog of NP, since it suffices for the 
purpose of establishing likely parameterized intractability. 

The classes \N[SAT], W[P] and the AW classes were introduced by Abra- 
hamson, Downey and Fellows in [2]. The class \N[SAT] is the collection of 
parameterized languages FPT-reducible to Weighted Sat. The class W[P] is 
the collection of parameterized languages FPT-equivalent to Weighted Cir- 
cuit Sat, the weighted satisfiability problem for a decision circuit C that is 
unrestricted. A standard translation of Turing machines into circuits shows that 
i^T- Weighted Circuit Sat is the same as the problem of deciding whether or 
not a deterministic Turing machine accepts an input of weight k. It is conjec- 
tured that the containment \N[SAT] C W[P] is proper |.125J. 

Another way to view W[P] is the following. Consider the problem Short 
Circuit Sat defined as follows. 

Short Circuit Sat 

Instance: A decision circuit C with at most n gates and A;logn inputs. 
Parameter: A positive integer k. 

Question: Is there a setting of the inputs making C true? 



Theorem 3.6 (Abrahamson, Downey and Fellows [2]). Short Circuit Sat 
is \N[P]- complete. 

Proof. The proof of this result uses the "/c • logn" trick introduced by Abra- 
hamson, Downey and Fellows [2]. To see that the problem is W[P]-hard, take 
an instance / of Weighted Circuit Satisfiability with parameter k and 
inputs xi, . . . , Xn- Let zi, . . . , Zfciogn be new variables. Using lexicographic or- 
der and in polynomial time we have a surjection from this set to the /c-element 

20 



subsets of xi, . . . , x„. Representing this as a circuit and putting this on the top 
of the circuit for I defines our new circuit C. The converse is equaUy easy. □ 

AW[t] captures the notion of alternation. AW[t] is the cohection of param- 
eterized languages FPT-reducible to Parameterized Quantified Circuit 
SATt, the weighted satisfiabihty problem for an unrestricted decision circuit 
that appHes alternating quantifiers to the inputs, defined here. 

Parameterized Quantified Circuit Satj 

Instance: A weft t decision circuit C whose inputs correspond to a sequence 
Si, . . . Sr of pairwise disjoint sets of variables. 
Parameter: r, ki, . . . ,kn. 

Question: Is it the case that there exists a size ki subset ti of si, such that for 
every size k2 subset t2 of S2 , there exists a size ks subset of S3 , such that . . . 
(alternating quantifiers) such that, when ti U t2 U . . . U are set to true, and 
ali other variables are set to false, C is satisfied? 

The idea here is to look at the analog of PSPACE. The problem is that in 
the parameterized setting there seems no naturai analog of Savitch's Theorem 
or the proof that QBFSat is PSPACE-complete, and it remains an interesting 
problem to formulate a true analog of parameterized space. 

The approach taken by [2j was to look at the parameterized analog of QBF- 
Sat stated above. 

One of the fundamental theorems proven here is that the choice of t is 
irrelevant: 

Theorem 3.7 (Abrahamson, Downey and Fellows [2J). AW[t] = AW[1] for ali 
t > 1. 

Many parameterized analogs of game problems are complete for the AW[1], 
such as the parameterized analog of Geography. 

Short Geography 

Instance: A directed graph D = {V,E) and a specified vertex vq. 
Parameter: A positive Integer k. 

Question: Does player 1 have a winning strategy in the following game? Bach 
player alternatively chooses a new are from E. The first are must have its tail 
as Vq, and each vertex subsequently chosen must have as its tail the head of the 
previously chosen are. The first player unable to choose loses. 

The class XP, introduced in |125| . is the collection of parameterized lan- 
guages L such that the k-th slice of L (the instances of L having parameter k) 
is a member of DTIME(n'^). XP is provably distinct from FPT and seems to be 
the parameterized class corresponding to the classical class EXP (exponential 
time). There are problems complete for XP including the game of A:-Cat and 
MiCE. The problem here is played on a directed graph G = {V, E) and begins 
with a distinguished vertex vq called the cheese, a token c on one vertex called 
the cat, and k tokens (called mice) on other vertices. Players cat and the team 
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of mice play alternatively moving one token at a time. A player can move a 
token along an are at eaeh stage. Team of mice wins if one mouse can reach 
the cheese (by occupying it even if the cat is aiready there) before the cat can 
eat one of the mice by occupying the same vertex. 

It is conjectured that ali of the containments given so far are proper, but 
ali that is currently known is that FPT is a proper subset of XP. 

There are hundreds of complete problems for the levels of the hierarchy. 
Here is a short list. The reader is referred to |116j for references and defini- 
tions. As stated XP has /c-Cat and Mouse Game and many other games; 
W[P] has Linear Inequalities, Short Satisfiability, Weighted Circuit 
Satisfiability and Minimum Axiom Set. There are a number of quite im- 
portant problems from combinatorial pattern matching which are W[t] hard 
for ah t: LONGEST Common Subsequence (fc = number of sequences, 
two parameters), Feasible Register Assignment, Triangulating Col- 
ORED Graphs, Bandwidth, Topological Bandwidth, Proper Inter- 
VAL Graph Completion, Domino Treewidth and Bounded Persistence 
Pathwidth. Some concrete problems complete for W[2] include Weighted 
{0, 1} Integer Programmino, Dominating Set, Tournament Dominat- 
ING Set, Unit Length Precedence Constrained Scheduling (hard), 
Shortest Common Supersequence (hard), Maximum Likelihood De- 
CODING (hard), Weight Distribution in Linear Codes (hard), Nearest 
Vector in Integer Lattices (hard). Short Permutation Group Fac- 
TORIZATION (hard). Finally a collection of W[l]-complete problems: /c-Step 
Derivation por Context Sensitive Grammars, Short NTM Compu- 
tation, Short Post Correspondence, Square Tiling, Weighted q- 
CNF Satisfiability, Vapnik-Chervonenkis Dimension, Longest Com- 
mon Subsequence {k, m = length of common subseq.), Clique, Inde- 
pendent Set, and Monotone Data Complexity for Relational Databases. 
This list is merely representative, and new areas of application are being found 
ali the time. There are currently good compendia of hardness and completeness 
results as can be found at the web 

http : //bravo . ce .uniroma2 . it/home/ cesati/research/ compendiuma/' 
For older material, see the appendix of the monograph by Downey and Fellows 
|125j , as well as the many surveys and the recent issue of the Computer Journal 

m- 

There remain several important structural questions associated with the 
W-hierarchy such as how it relates to the A-hierarchy below, and whether any 
collapse may propagate. 

Open questions : Does W[t] = W[t+1] imply W[t] = W[t+2]? Does \N[t] = FPT 
imply \N[t + l] = FPT? 

3.4- The A-hierarchy and the Flum-Grohe approach 

There have been several attempts towards simplification of this material, 
notably by Flum and Grohe |154j . Their method is to try to make the use of 
logicai depth and logie more explicit. To do this Flum and Grohe take a detour 
through the logie of finite model theory. Close inspection of their proofs reveals 
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that similar combinatorics are hidden. Their view is that model checking should 
be viewed as the fundamental viewpoint of complexity. 

To this end, for a class of first order formula with s-ary free relation vari- 
able, we can define p-WD{ip) as the problem: 

p-WD{ip) 

Instance: A structure A with domain A and an integer k. 
Parameter: k. 

Question: Is there a relation R'^ A^ with |iì| = A; such that A 1= ^p{R)'? 

This idea naturally extends to classes ^ of formulae ^. Then we define 
p-WD(<ì>) to be the class of parameterized problems p-WG^ip) for (/? G $. It 
is easy to show that p-WD(Si) = FPT. (Strictly, we should write but 
the formulae considered here are first order.) Then to recast the classical W- 
hierarchy at the finite levels, the idea is to define for t > 1, 

W[t] = [p-WD{Ut)f''^ , 

where, given a parameterized problem X, [X]^^'^ denotes the parameterized 
problems that are FPT-reducible to X. 

Flum and Grohe have similar logic-based formulations of the other W-hie- 
rarchy classes. We refer the reader to [154 ] for more details. 

We remark that the model checking approach leads to other hierarchies. 
One important hierarchy found by Flum and Grohe is the A-hierarchy which 
is also based on alternation like the AW-hierarchy but works differently. For a 
class $ of formulae, we can define the foUowing parameterized problem. 

p-MC($) 

Instance: A structure A and a formula ip £ ^. 
Parameter: \{p\. 

Question: Decide if (j){A) ^ 0, where this denotes the evaluation of (p in A. 
Then Flum and Grohe define 

For instance, for k > 1, /c-Clique can be defined by 

clique^ = 3xi,...Xk{ f\ Xi ^ xj A /\ ExiXj) 

in the language of graphs, and the interpretation of the formula in a graph G 
would be that G has a clique of size k. Thus the mapping (G, k) i— )■ (G, clique^) 
is a FPT reduction showing that parameterized Clique is in A[l]. Flum and 
Grohe populate various levels of the A-hierarchy and show the following. 

Theorem 3.8 (Flum and Grohe [154J). The following hold: 



(i) A[1]=W[1]. 
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(ii) A[t] C \N[t]. 



Clearly A[t] C XP, but no other containment with respect to other classes of 
the W-hierarchy is known. It is conjectured by Flum and Grohe that no other 
containments than those given exist, but this is not apparently related to any 
other conjecture. 

If we compare classical and parameterized complexity it is evident that the 
framework provided by parameterized complexity theory allows for more finely- 
grained complexity analysis of computational problems. It is deeply connected 
with algorithmic heuristics and exact algorithms in practice. We refer the reader 
to either the survey |154j , or those in two recent issues of The Computer Journal 
|128j for further insight. 

We can consider many different parameterizations of a single classical prob- 
lem, each of which leads to either a tractable, or (likely) intractable, version in 
the parameterized setting. This allows for an extended dialog with the problem 
at hand. This idea towards the solution of algorithmic problems is explored 
in, for example, |131j . A nice example of this extended dialog can be found in 
the work of Iris van Rooij and her co-authors, as discussed in van Rooij and 
Wareham [278] . 

3. 5. Connection with PTAS 's 

The reader may note that parameterized complexity is addressing intractabil- 
ity within polynomial time. In this vein, the parameterized framework can be 
used to demonstrate that many classical problems that admit a PTAS do not, 
in fact, admit any PTAS with a practical running time, unless W[l] = FPT. 
The idea here is that if a PTAS has a running time such as 0{n'i), where e is 
the error ratio, then the PTAS is unlikely to be useful. For example if e = 0.1 
then the running time is already n to the lOth power for an error of 10%. What 
we could do is regard ^ as a parameter and show that the problem is W[l]-hard 
with respect to that prameterization. In that case there would likely be no 
method of removing the ^ from the exponent in the running time and hence no 
efìicient PTAS, a method first used by Bazgan [25j. For many more details of 
the method we refer the reader to the survey ^ITB] . 

A notable application of this technique is due to Cai et. al. [M] who showed 
that the method of using planar formulae tends to give PTAS's that are never 
practical. The exact calibration of PTAS's and parameterized complexity comes 
through yet another hierarchy called the M-hierarchy. The breakthrough was 
the realization by Cai and Juedes [53] that the collapse of a basic sub-hierarchy 
of the W-hierarchy was deeply connected with approximation. 

The base level of the hierarchy is the problem M[l] defined by the core prob- 
lem below. 

Instance: A CNF circuit C (or, equivalently, a CNF formula) of size k log n. 
Parameter: A positive integer k. 
Question: Is C satisfiable? 
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That is, we are parameterizing the size of the problem rather than some 
aspect of the problem. The idea naturally extends to higher levels for that, for 
example, M[2] would be a product of sums of product formula of size klogn 
and we are asking whether it is satisfiable. 

The basic result is that FPT C M[l] C W[l]. The hypothesis FPT / M[l] is 
equivalent to ETH. In fact, as proven in [76], there is an isomorphism, the so- 
called miniaturization, between exponential time complexity (endowed with a 
suitable notion of reductions) and XP (endowed with FPT reductions) such that 
the respective notions of tractability correspond, that is, subexponential time on 
the one and FPT on the other side. The reader might wonder why we have not 
used a Turing Machine of size A;logn in the input, rather than a CNF circuit. 
The reason is that whilst we can get reductions for small version of problems, 
such as A: log n- Vertex Cover and the like, to have the same complexity as 
the circuit problem above, we do not know how to do this for Turing machines. 
It remains an open question whether the /clogn-sized circuit problem and the 
fclogn-sized Turing Machine problem have the same complexity. 

For more on this topic and other connections with classical exponential 
algorithms we refer the reader to the survey of Flum and Grohe |154j . 

3.6. FPT and XP optimality 

Related to the material of the last section are emerging programmes devoted 
to proving tight lower bounds on parameterized problems, assuming various 
non-collapses of the parameterized hierarchies. For this section, it is useful 
to use the O* notation for parameterized algorithms. This is the part of the 
running time which is exponential. For example, a running time of 2^ \G\^ 
would be written as 0*{2^ ). 

One example of a lower bound was the originai paper of Cai and Juedes 
\b'ò\ [M] who proved the following definitive result. 

Theorem 3.9. A; -Planar Vertex Cover, A: -Planar Independent Set, 
A;-Planar Dominating Set, and ^-Planar Red/Blue Dominating Set 
cannot he in 0*(2°(^)) -FPT unless FPT = M[l] (or, equivalently, unless ETH 
fails). 

The optimality of Theorem |3 . 9| follows from the fact that ali above problems 
have been classified in 0*(2<^(^^-FPT as proved in [HI [MI |207l [2l0] (see also 



Subsection 4.3.3) 



We can ask for similar optimality results for any FPT problem. See for ex- 
ample, Chen and Flum [74j . We will meet another approach to FPT optimality 
in Subsection |3.11| where we look at classes like EPT meant to capture how 
problems are placed in FPT via another kind of completeness programme. 

Another example of such optimality programmes can be found in exciting 
resent work on XP optimiality. This programme represents a major step forward 
in the sense that it regards the classes like W[l] as artifacts of the basic problem 
of proving hardness under reasonable assumptions, and strikes at membership 
of XP. 

Here are some examples. We know that Independent Set and Dominat- 
ing Set are in XP. 
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Theorem 3.10 (Chen et. al p]). The following hold: 

(i) Independent Set cannot he solved in Urne unless FPT = M[l]. 

(ii) DOMINATING Set cannot be solved in Urne n°('^) unless FPT = M[2]. 

A beautiful development in this area is the resent paper by Marx on the 
Closest Substring problem. We refer to Marx |223j for more details, and to 
Chen and Meng [72j for other related results. 

There remains a lot of work to be done here and these programmes appear 
to be exciting developments, see e.g., |157[ 1159] I219[ [220] . 

3.7. Other classical applications 

Similar techniques have been used to solve a significant open question about 
techniques for formula evaluation when they were used to show "resolution is 
not automizable" unless W[P] = FPT (Alekhnovich and Razborov [13], Eick- 
meyer, Grohe and Griiber [137J.) Parameterized complexity assumptions can 
also be used to show that the large hidden constants (various towers of two's) 
in the running times of generic algorithms obtained though the use of algo- 
rithmic meta-theorems cannot be improved upon (see |155j .) One illustration 
is obtained through the use of locai treewidth (which we will discuss in Subec- 
tion 4.2.2). The notions of treewidth and branchwidth are by now ubiquitous 
in algorithmic graph theory (the definition of branchwidth is given in Sub- 
section 4.2.1). Suffice to say is that it is a method of decomposing graphs to 
measure how "treelike" they are, and if they have small treewidth/branchwidth, 
as we see m Subection |42T| we can run dynamic programming algorithms upon 



them. The locai treewidth of a class C of graphs is called bounded iff there a 
function / such that for ali graphs G & C and ali vertices v G y{G) the neigh- 



borhood of v of distance k from v has treewidth f{k) (see Subsection 4.2.2). 
Examples include planar graphs and graphs of bounded maximum degree. The 
point is that a class of graphs of bounded locai treewidth is automatically FPT 
for a wide class of properties. 

Theorem 3.11 (Frick and Grohe |169j ì. Deciding first- order statements is FPT 
for every fixed class of graphs of bounded locai treewidth. 

One problem with this algorithmic meta-theorem is that the algorithm ob- 
tained for a fixed first-order statement ip can rapidly have towers of twos de- 
pending on the quantifier complexity of the statement, in the same way that 
this happens for Courcelle's theorem on decidability of monadic second order 



statements (as discussed in Subsection 4.2.1) for graphs of bounded treewidth. 



What Frick and Grohe [170] showed is that such towers of two's cannot be 
removed unless W[P] = FPT. 

Another use of parameterized complexity is to give an indirect approach 
to proving likely intractability of problems which are not known to be NP- 
complete. A classic example of this is the following problem. 

Precedence Constrained A;-Processor Scheduling 
Instance: A set T of unit-length jobs and a partial ordering ^ on T, a positive 
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deadline D and a number of processors k. 
Parameter: A positive integer k. 

Questioni Is there a mapping f : T ^ {1, . . . , D} such that for ali t ~< t' , 
f{t) -< fit'), and for alH, 1 < i < D, < k?. 

In general this problem is N P-complete and is known to be in P for 2 proces- 
sors. The question is what happens for k > 2 processors. For us the question 
becomes whether the problem is in XP for k > 2 processors. This remains 
one of the open questions from Garey and Johnson's famous book jl72) (Open 
Problem 8), but we have the following. 

Theorem 3.12 (Bodlaender, Fellows and Hahett Precedence Con- 

STRAINED /c-Processor Scheduling is \N[2]-hard. 

The point here is that even if Precedence Constrained fc-PROCESSOR 
Scheduling is in XP, there seems no way that it will be feasible for large 
k. Researchers in the area of parameterized complexity have long wondered 
whether this approach might be applied to other problems like Composite 
Number or Graph Isomorphism. For example, Luks |222j has shown that 
Graph Isomorphism can be solved in 0{n^) for graphs of maximum degree 
k, but any proof that the problem was W[l] hard would clearly imply that the 
general problem was not feasible. We know that Graph Isomorphism is almost 
certainly not N P-complete, since proving that would collapse the polynomial 
hierarchy to 2 or fewer levels (see the work of Schòning in j262j ). Similar 
comments can be applied to graphs of bounded treewidth by Bodlaender [33] . 

3.8. Other parameterized classes 

There have been other parameterized analogs of classical complexity ana- 
lyzed. For example McCartin |227j and Flum and Grohe |153j each analyzed 
parameterized counting complexity. Here we can define the class ^W[l] for 
instance (with the core problem being counting the number of accepting paths 
of length /c in a nondeterministic Turing machine) , and show that counting the 
number of k cliques is 7^W[l]-complete. Notably Flum and Grohe proved the 
following analog to Valiant's Theorem on the permanent. 

Theorem 3.13 (Flum and Grohe [153J). Counting the number of cycles of size 
k in a bipartite graph is ^\N\i\- complete. 

One of the hallmark theorems of classical complexity is Toda's Theorem 
which states that P*'^ contains the polynomial time hierarchy. There is no 
known analog of this result for parameterized complexity. One of the prob- 
lems is that ali known proofs of Toda's Theorem filter through probabilistic 
classes. Whilst there are known analogs of Valiant's Theorem (Downey, Fel- 
lows and Regan |130j . and Mùller [230^ I231j ). there is no known method of 
"small" probability amplification. (See Montoya j229| for a thorough discus- 
sion of this problem.) This seems the main problem and there is really no 
satisfactory treatment of probability amplification in parameterized complex- 
ity. For example, suppose we wanted an analog of the operator calculus for 

27 



parameterized complexity. For example, consider BP • ©W[P], as an analog of 
BP • ©P. We can defìne L e ©W[P] to mean that {x, /c) e L iff (x, k) ^ {x' , k') 
where x' is a circuit with (e.g.) A:log|a;'| inputs and the number of accepting 
inputs is odd. We need that there is a language L G BP -C iff there is a language 
L' & C such that for ali (x, k), 

(x, fc) G L iff a randomly chosen (x, k, k') G L' . 

A problem will appear as soon as we try to prove the analog basic step in Toda's 
Theorem: W[P] C BP • ©W[P]. The first step in the usuai proof of Toda's Theo- 
rem, which can be emulated, is to use some kind of random hashing to result in 
a ©W[P] circuit with either no accepting inputs, or exactly one accepting input, 
the latter with nonzero probability. So far things work out okay. However, the 
next step in the usuai proof is to amplify this probability: that is, do this a 
polynomial number of times independently to amplify by majority to get the 
result in the BP class. The problem is that if this amplification uses many in- 
dependently chosen instances, then the number of input variables goes up and 
the the result is no longer a W[P] circuit since we think of this as a polynomial 
sized circuit with only kìogn many inputs. There is a fundamental question: 
Is it possible to perform amplification with only such limited nondeterminism? 
Notable here are the following: 

Theorem 3.14 (Downey, Fellows and Regan |13U| ). For ali t, there is a ran- 
domized FPT -reduction from \N[t] to unique W[t]. (Analog of of the Valiant- 
Vaziarini Theorem) 

Theorem 3.15 (Mùller [232]). W[P] • BPFPT (an analog o/BPPj has weakly 
uniform derandomization ("weakly uniform" is an appropriate technical condi- 
tion) iff there is a polynomial time computahle unbounded function c : N — >• N 
with BPP(c) = P, where BPP(c) denotes BPP with only access to c(n)logn 
nondeterministic hits. 

Moritz Miiller's result says that, more or less, parameterized derandom- 
ization implies nontrivial classical derandomization. Other interesting work on 
randomization in parameterized complexity is to be found in the work of Miiller. 
For instance, in |230j . he showed that there is a Valiant-Vaziarini type lemma 
for most W[t] -complete problems, including e.g. Unique Dominating Set. 
The only other work in this area is in the papers of Montoya, such as [229J. In 
[229], Montoya showed that it is in a certain sense unlikely that BP-W[P], an 
analogue of the classical Arthur-Merlin class, allows probability amplification. 
(That is, amplification with k log n bits of nodeterminism is in a sense unlikely.) 
Much remains to do here. 

Perhaps due to the delicacy of material, or because of the focus on practical 
computation, there is only a little work on what could be called parameterized 
structural complexity. By this we mean analogs of things like Ladner's Theorem 
(that if P 7^ NP then there are sets of intermediate complexity) (See |117j ). 
Mahaney's Theorem that if there is a sparse NP complete set then P = NP 
(Cesarti and Fellows [58], the PCP Theorem, Toda's theorem etc. There is a 
challenging research agenda here. 
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3.9. Parameterized approximation 

One other fruitful area of research has been the area of parameterized ap- 
proximation, beginning with three papers at the same conference! (Cai and 
Huang [52], Chen, Grohe and Grùber [77], and Downey, Fellows and McCartin 
|118j). Parameterized approximation was part of the folklore for some time 
originating with the dominating set question originally asked by Fellows. For 
parameterized approximation, one inputs a problem and asks for either a solu- 
tion of size f{k) or a statement that there is no solution of size k. This idea 
was originally suggested by Downey and Fellows, inspired by earlier work of 
Robertson and Seymour on approximations to treewidth. Of course, we need 
to assume that FPT ^ W[l] for this to make sense. A classical example taken 
from Garey and Johnson |172j is BiN Packing where the First Fit algorithm 
either says that no packing of size k exists or gives one of size at most 2k. As 
observed by Downey, Fellows and McCartin |118j most \N[t] hard problems do 
not have approximations with an additive factor (i.e. f{k) = k + e) unless 
W[t] = FPT. One surprise from that paper is the following. 

Theorem 3.16 (Downey, Fellows, McCartin |118j ). The problem Indepen- 
DENT Dominating Set which asks if there is a dominating set of size k which 
is also an independent set, has no parameterized approximation algorithm for 
any computable function f{k) unless W[2] = FPT. 

Subsequently, Eickmeyer, Grohe Grùber showed the following in fl37j. 

Theorem 3.17. If L is a "naturai" \N[P]- complete language then L has no 
parameterized approximation algorithm unless W[P] = FPT. 

The notion of "naturai" here is indeed quite naturai and covers ali of the 
known W[P]-complete problems, say, in the appendix of Downey and Fellows 
[l25j . We refer the reader to [137J for more details. 

One open question asks whether there is any multiplicative FPT approxi- 
mation for Dominating Set. This question of Mike Fellows has been open for 
nearly 20 years and asks in its oldest incarnation whether there is an algorithm 
which, on input (G, k) either says that there is no size k dominating set, or that 
there is one of size 2k. 



3.10. Limits on kernelization 

There has been important recent work concerning limitations of parameter- 
ized techniques. One of the most important techniques is that of kernelization. 
We will see in Subsection 4.4 that this is one of the basic techniques of the area, 
and remains one of the most practical techniques since usually kernelization is 
based around simple reduction rules which are both locai and easy to imple- 
ment. (See, for instance Abu-Khzam, et. al. [3|, Flum and Grohe jl54j . or 
Guo and Niedermeier [185].) The idea, of course, is that we shrink the problem 
using some polynomial time reduction to a small one whose size depends only 
on the parameter, and then do exhaustive search on that kernel. Naturally the 
latter step is the most time consuming and the problem becomes how to find 
small kernels. An important question is therefore: When is it possible to show 
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that a problem has no polynomial kernel? A formai defìnition of kernelization 
is the following: 

Defìnition 3.18 (Kernelization). A kernelization algorithm, or in short, a 
kernel for a parameterized problem L C S* x N is an algorithm that given 
(x, k) gT,* X N, outputs in p{\x\ + k) time a pair (x', k') G S* x N such that 

• (x, A;) G L <^ (a;', A;') G L, 

• (|x'|,A:')</(fc), 

where / is an arbitrary computable function, and p a polynomial. Any function 
/ as above is referred to as the size of the kernel. We frequently use the term 
"kernel" for the outputs (|x'|,A:') of the kernelization algorithm and, in case / 
is a polynomial (resp. linear) function, we say that we have a polynomial (resp. 
linear) kernelization algorithm oi, simply, a polynomial (resp. linear) kernel. 

Clearly, if P = NP, then ali problems have Constant size kernels so some 
kind of complexity theoretical hypothesis is needed to show that something 
does not have a small kernel. The key thing that the reader should realize 
is that the reduction to the kernel is a polynomial time reduction for both 
the problem and parameter, and not an FPT algorithm. Limiting results on 
kernelization mean that this often used practical method cannot be used to get 
FPT algorithms. Sometimes showing that problems do not have small kernels 
(modulo some hypothesis) can be extracted from work on approximation, since 
a small kernel is, itself, an approximation. Thus, whilst we know of a 2k kernel 
for /c-Vertex Cover |234j . we know that unless P = NP, we cannot do better 
than size 1.36 • k using Dinur and Safra |107j . since the PCP theorem provides 
a 1.36-lower bound on approximation (see also [185J). 

To show that certain problems do not have polynomial kernels modulo a 
reasonable hypothesis, we will need the following defìnition, which is in classical 
complexity. (It is similar to another defìnition of Harnik and Noar |189) ) . 

Defìnition 3.19 (Or-Distillation). An Or-distillation algorithm for a classical 
problem L C S* is an algorithm that 

• receives as input a sequence (xi, . . . , xt), with Xj G S* for each 1 < i < t, 

• uses time polynomial in Yl\=i l^d) 

• and outputs a string y G S* with 

1. y £ L <;=^ Xi £ L for some 1 < i < t. 

2. \y\ is polynomial in maxi<j<t |xj|. 

We can similarly defìne And-distillation by replacing the second last item 
by "y G L Xi € L for ali 1 < i < t." Bodlaender, Downey, Fellows and 

Hermelin [35] showed that an N P-complete problem has an Or-distillation algo- 
rithm iff ali of them do. On general Kolmogorov complexity grounds, it seems 
very unlikely that N P-complete problems have either distillation algorithms. 
Following a suggestion of Bodlaender, Downey, Fellows and Hermelin, Fort- 
now and Santhanam related Or-distillation to the polynomial time hierarchy as 
follows. 
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Lemma 3.20 ([167]). If any NP-complete problem has an Or-distillation algo- 
rithm then co-NP C NP\Poly and hence the polynomial Urne hierarchy collapses 
to 3 or fewer levels. 



At the time of writing, there is no known version of Lemma 3.20 for And- 
distillation and it remains an important open question, whether NP-complete 
problema having And-distillation implies any classical collapse of the polynomial 
time hierarchy. This material ali relates to kernelization as follows. 

Definition 3.21 (Composition). An Or- campo sition algorithm for a parame- 
terized problem L C S* x N is an algorithm that 

• receives as input a sequence {{xi, k), . . . , {xt,k)), with (xj, k) £ T,* x 
for each 1 < i <t, 

• uses time polynomial in Yll=i \^i\ + 

• and outputs {y, k') G S* x N+ with 

1. (y, k') € L <;=^ (xj, k) £ L for some 1 < i < t. 

2. A;' is polynomial in k. 

Again we may similarly define And-composition. The key lemma relating 
the two concepts is the following, which has an analogous statement for the 
And-distillation case: 

Lemma 3.22 (Bodlaender, Downey, Fellows and Hermelin [35]). Let L he a 

Or-compositional parameterized problem whose unparameterized version L is 
NP-complete. If L has a polynomial kernel, then L is also Or-distillahle. 

Distillation of one problem within another has also been discussed in Chen, 
Flum and Miiller f35l|. 



Using Lemma 3.22, Bodlaender, Downey, Fellows and Hermelin |35j proved 
that a large class of graph-theoretic FPT problems including /c-Path, A;-Cycle, 
various problems for graphs of bounded treewidth, etc, ali have no polynomial- 
sized kernels unless the polynomial-time hierarchy collapses to three or fewer 
levels. 

For And-composition, tying the distillation to something like the Fortnow- 
Santhanam material would be important since it would say that important FPT 
problems hke Treewidth and Cutwidth would hkely not have polynomial 
size kernels, and would perhaps suggest why algorithms such as Bodlaender's 
linear time FPT algorithm |34j (and other treewidth algorithms) is so hard to 
run. Since the originai paper [35], there have been a number of developments 
such as the Bodlaender, Thomassé, and Yeo [l3] use of reductions to extend 
the arguments above to wider classes of problems such as Disjoint Paths, 
DisjoiNT Cycles, and Hamilton Cycle Parameterized by Treewidth. 
In the same direction, Chen, Flum and Miiller [75] used this methodology to 
further explore the possible sizes of kernels. One fascinating application was by 
Fernau et. al. |151j . They showed that the following problem was in FPT, by 
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showing a kernel of size O(fc^). 
ROOTED A;-OutLeaf Branching 

Instance: A directed graph D = {V,E) with exactly one vertex of indegree 
called the root. 

Parameter: A positive integer k. 

Question: Is there an oriented subtree T oiD with exactly k leaves spanning DI 

However, for the unrooted version they used the machinery from [35j to 
demonstrate that it has no polynomial-size kernel unless some collapse occurs, 
but clearly by using n independent versions of the rooted version the problem 
has a polynomial-time Turing kernel. We know of no method of dealing with 
the non-existence of polynomial time Turing kernels and it seems an important 
programmatic question. 

Ali of the material on lower bounds for Or distillation tend to use reductions 
to things like large disjoint unions of graphs having Or composition. Thus, 
problems sensitive to this seemed not readily approachable using the machinery. 
Very recently, Stefan Kratsch |211j discovered a way around this problem using 
the work Dell and van Melkebeek |92j . 

Theorem 3.23 (Kratsch |,211j ). The FPT problem ^-Ramsey which asks if a 
graph G has either an independent set or a clique of size k, has no polynomial 
kernel unless NPCl co — NP\poly. 

The point here is that a large collection of disjoint graphs would have a 
large independent set, hence new ideas were definitely needed. The ideas in 
Kratsch's proof are quite novel and use co-nondetermism in compositions and 
communication complexity in a quite novel way. Perhaps they might allow us 
to attack other such problems. 

Finally, we remark in passing that as an important spinoff of the question 
from parameterized complexity, the Fortnow-Santhanam Lemma has been used 
by Burhmann and Hitchcock |47j to show that unless the polynomial-time hi- 
erarchy collapses, NP-hard languages must be exponentially dense (meaning 
that hard instances must occur very often), perhaps suggesting a connection 
between parameterized complexity and density of hard instances. 

For further techniques on lower bounds on kernels, see |108j . 

3.11. Bounded parameterized complexity 

Another direction exploring the fine structure of FPT was taken by Flum, 
Grohe and Weyer |156j who suggested that the important problems were those 
where the constants were small. If L is FPT then the question "(x, k) G L?" 
is decidable in time f{k)\x\'^, for some computable function /. But as we have 
seen / could be anything. Flum, Grohe and Weyer argue that the correct 
classes to focus upon are those with membership algorithms of the form 2°*^'^^ Ixl*^, 
20(fc)|^|c^ and 2P°ly('=)|x|^ These classes are called SUBEPT, EPT and EXPT, 
respectively. As a group they are referred to as bounded FPT. Interestingly, the 
reductions may be different for the different classes, because the idea is to give 
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the maximum power possible to the reductions and yet stiU remain within the 
class. For putting this idea in a general framework, we mention Downey, Flum, 
Grohe and Weyer jl56j . 

Of course, any reduction {x, k) i— >• {x' , k') which is polynomial in both vari- 
ables will keep the problem within the relevant class. As an example, one of 
the most useful reductions here is the EPT reduction which asks that there is 
a function / G 2^^^^ so that x' is computable in time f{k)\xY' and there is a 
Constant d such that k' < d{k + log|x|). It is easy to see that EPT is closed 
under EPT reductions. 

Concentrating on EPT as a representative example, the next step is to in- 
troduce classes akin to the W-hierarchy for the bounded theory. For example, a 
nondeterministic {2^^^\k)-restricted Turing machine is one for which there is 
a function / G 2'^^'^^ that for each run on input x the machine performs at most 
f{k) ■ \x\'^'^ many steps such that at most C2(A;-|-log |x|) -log |x| are nondetermin- 
istic. Using this as the core problem, and closing under EPT reductions defines 
the class EW[P]. More generally, it is possible to extend this definition to define 
another hierarchy akin to the W-hierarchy called the EW-hierarchy. It is, of 
course, easy to show that the classes EPT, EXPT, SUBEPT are ali distinct by 
diagonalization. But what the new hierarchy allows for is to show that various 
problems which are ali W[l]-hard, say, differ on the new hierarchy, aligning with 
our intuition that they should be. As an illustration, there is a problem from 
computational learning theory called the Vapnik-Chervonenkis Dimension 
which is proven to be W[l]-complete by combining Downey, Evans and Fellows 
|120j and Downey and Fellows |124j . The hardness proof in |120j used explic- 
itly non-polynomial FPT reductions. It turns out that Vapnik-Chervonenkis 
Dimension is complete for EW[3], and yet the problem Tournament DOMI- 
NATING Set which is W[2]-complete is complete for the class EW[2]. 

Little is known here. It would be fascinating if a centrai FPT problem 
with infeasible algorithms at present, such as Treewidth could be shown to 
be complete for, say, EW[2], which would suggest no possible reasonable FPT 
algorithm. The current algorithms only put Treewidth info EXPT. 

From [156] one example of this phenomenon is First- Order Model- 
Checking over Words: it is in FPT but even EAW[*]-hard (a bounded analog 
of AW). 

3.12. Things left out 

In such a short article, we do not really have space to devote to the many 
areas of applications for this hardness theory. Sufìice to say, it has been applied 
in relational databases, phylogeny, linguistics, VLSI design, graph structure 
theory, cognitive science, Nash equilibria, voting schemes, operations research, 
etc. We can only point at the various survey articles, the books by Niedermeier's 
|240j , Fernau (150j , and Flum and Grohe |il55j as well as the Computer Journal 
issues mentioned earlier |128| . 

Also we have not really had space to devote neither to many other naturai 
hierarchies based on various aspects of logicai depth such as the S, W* and 
other hierarchies, nor to issues like parameterized parallelism. Here we refer 
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the reader to Flum and Grohe [155] . Finally, we have not really developed ali 
of the models which have been used. 

What we hope the reader has gotten is the general flavor of the parameter- 
ized complexity subject and some appreciation of the techniques. 

4. Parameterized algorithms 

The diversity of problems and areas where parameterized algorithms have 
been developed is enormous. In this section we make an, unavoidably incom- 
plete, presentation of the main techniques and results on the design of param- 
eterized algorithms. To facilitate our description, we are mainly focusing on 
problems on graphs. 

Some basic notational conventions on graphs follow: Given a graph, G we 
denote the vertex and edge set of G by V{G) and E{G) respectively. Given a 
vertex v S y{G) we denote the set of its neighbors by Ng{v). When a graph 
G is the input of a parameterized problem, we always denote by n the number 
of its vertices. 

4.1. De-nondeterminization 

Parameterized algorithm design requires a wider viewpoint that the classic 
one of polynomial algorithm design. The reason is that we now permit time 
complexities that are super-polynomial. However, we have to make sure that 
this super-polynomial overhead depends only on the parameter. A wide family 
of techniques in parameterized algorithm design can be seen as ways to turn 
some polynomial non-deterministic algorithms to a deterministic one where the 
resulting super-polynomial overhead is independent of the main part of the 
problem. 

4-1.1. Bounded search trees 

The most ubiquitous de-nondeterminization technique is the bounded search 
tree technique. We present it on one of the most extensively studied problems 
in parameterized algorithms and complexity: 

/c- Vertex Cover 

Instance: A graph G and a non- negative integer k. 
Parameter: k. 

Questioni Does G have a vertex set S of size at most k that intersects ali the 
edges of GÌ 

This problem can be solved by the following non-deterministic algorithm: 

1. set 5 and i k, 

2. while E{G) / and z > 1, 

consider some edge e = {v,u} oì G, 

guess non-deterministically one, say x, of the two endpoints of e, 
set G G \ X, i ■(— z — 1 

3. if ^(G) = then return YES 

4. li k = 0, then return NO 
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Clearly, this algorithm is based on the fact that for each edge, one of its 
endpoints should be a vertex of every vertex cover. It makes at most k non- 
deterministic choices each requiring 0{n) deterministic steps. This polynomial 
non-deterministic algorithm can be reverted to an (exponential) deterministic 
one as fohows. 

AlgoTithm algvc(G, A;) 

1. if = 0, then return YES 

2. if A; = 0, then return NO 

3. choose (arbitrarily) an edge e = G E{G) and 

return algvc(G — v,k — \) \/algvc(G — u,k — 1) 

Notice that the above algortihm makes 2 recursive caUs and the depth of 
the recursion is < k. Therefore it takes 0{2^ ■n) steps and is an FPT-algorithm. 
This implies that A;- Vertex Cover e FPT. Notice that the algorithm is based 
on the transformation of a non-deterministic algorithm to a deterministic one 
in a way that the exponential blow-up (i.e., the size of the search tree) depends 
exclusively on the parameter k. This idea traces back to the paper of Buss and 
Goldsmith in [15] and the corresponding technique is called the bounded search 
tree technique. 

Can we do better? A positive answer requires a better combination of non- 
deterministic guesses. As an example, instead of an edge one may pick a path 
P with vertices vi,V2,V3, and V4. Then every vertex cover of G will contain 
some of the pairs {^1,^2}, {v2,V3}, {^2,^4}. That way, each recursive cali has 
now 3 calls but also guesses 2 vertices and therefore the depth of the recursion 
is at most [A;/2]. In case G does not contain a path of length 3, then G is a 
forest of stars and in such a case the A;- Vertex Cover can be solved in linear 
time. Summing ali this together, we have a 0(3'^/^ • n) step FPT-algorihtm for 
the A:- Vertex Cover which improves the previous one, as 3^/^ < 1.733. An 
even faster algorithm can be designed if we exploit the fact that the A;- Vertex 
Cover can be solved in linear time for graphs of maximum degree 2. Then, 
as long as there is a vertex v with at least 3 neighbors, we know that a vertex 
cover should contain v or ali its neighbors. An elementary analysis implies that 
the size T{k) of the search tree satisfies the relation T{k) < T{k — 1) + T(A; — 3). 
As the biggest root of the characteristic polynomial = af'^^ + a^~^ is less 
than 1.466, we have an FPT-algorithm for the the A;- Vertex Cover that runs 
in 0(1. 466^^ • n) steps. 

Especially for A;- Vertex Cover, there is a long sequence of improvements 
of the running time, based on even more refined search trees. The first non- 
trivial results dates back to the 0(1.3248'^ • n) step algorithm of Balasubra- 
manian, Fellows, and Raman [21]. This result was improved in [671 1241| and, 
currently, the fastest parameterized algorithm for A;- Vertex Cover runs in 
0(1.2738'^ + kn) steps by Chen, Kanj, and Xia [68] • For applications of the 
same technique on restricted versions of the same problem, see [691 1242j . 

We stress that the bounded search tree technique is strongly linked to 
the design of exact algorithms, as FPT-algorithms can be seen as exact al- 
gorithms where the parameter is not any more restricted. For instance, the 
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0(1.2738'' + kn) step algorithm of [68] implies an O* (1.2738") stepexact al- 
gorithm for Vertex Cover. However, the existence of fast exact algorithms 
does not imply directly the existence of a parameterized one with the same pa- 
rameter dependence. For example Vertex Cover can be solved in O* (1.189"") 
steps by an algorithm of Robson [258j (see also jl60| for a simpler one running 
in 0(1.221^=) steps). 

The bounded search tree technique is an unavoidable ingredient of most 
parameterized algorithms. Typical examples of problems where this technique 
has been applied are Feedback Vertex Set [M] (0(5'^ • kn'^) steps ~ see 
also [smisi]), Cluster Editing [30j (0((1.82)'' + n^) steps - see also [T77| ì. 
DOMINATING Set [T6j, and partial covering problems [20] . 

4-1-2. Greedy localization 

A step further in the branching approach is to combine it with some non- 
deterministic guess of some part of the solution. This idea is known as the 
greedy localization technique and was introduced in [65] and [199j . We will 
briefly present the idea using the following problem. 

fc-TRIANGLE PACKING 

Instance: A graph G and a non- negative integer k. 
Parameter: k. 

Question: Does G have at least k mutually vertex disjoint triangles? 

Again, we describe the FPT-algorithm for this problem in its non-deterministic 
version. We use the term partial triangle for any vertex or edge of G and we will 
treat it as a potential part of a triangle in the requested triangle packing. The 
first step is to find in G a maximal set of disjoint triangles T = {Ti, . . . ,Tr}. 
This greedy step justifies the name of the technique and can be done in poly- 
nomial time. If r > A: then return YES and stop. If not, let Gj- he the 
graph formed by the disjoint union of the triangles in T and and observe that 
|y(G7-)| < 3(A; — 1). The key observation is that if there exists a solution 
T' = {T{, . . . ,T^} to the problem (r' > fc), then each T/ should intersect some 
triangle in T, (because of the maximality of the choice of T). These intersec- 
tions define a partial solution V = {Ai, . . . , Ap} of the problem. The next step 
of the algorithm is to guess them: let 5 be a subset of V^G-y) such that Gt[S] 
has at least k connected components (if such a set does not exist, the algorithm 
returns NO and stops). Let V = {Pi, . - . , Pp} he these connected components 
and observe that each Pi is a partial triangle of G. We also denote by F(P) the 
set of vertices in the elements of V. Then, the algorithm intends to extend this 
partial solution to a full one using the following non-deterministic procedure 
branch(P): 

Procedure branch(Pi, . . . , Pp) 

1. ^ ^ 5 ^ 0, i ^ 1 

2. while i < p 

if there exists a partial triangle B of G \ {V (V) L) A) 
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such that G[Pi L) B] is a triangle, 
then AU B, i ^ i + 1 
otherwise goto step 4 

3. return YES and stop. 

4. let A' be the set containing each vertex v £ A 

such that Pi U {v} is a (partial) triangle. 

5. if A' = 0, then return NO and stop, 

otherwise guess v £ A' and 

return branch(Pi, . . . , Pj U {v} . . . , Pp). 

In Step 2, the procedure checks greedily for a possible extension of P to a 
fuh triangle packing. If it succeeds, it enters Step 3 and returns YES. If it 
fails at the i-th iteration of Step 2, this means that one of the vertices used 
for the current extension (these are the vertices in A' constructed in Step 4) 
should belong to the extension of Pi (if such a solution exists). So we further 
guess which vertex of A should be added to Pi and we recurse with this new 
collection of partial triangles (if such a vertex does not exist, return a negative 
answer). This algorithm has two non deterministic steps: one is the initial 
choice of the set S and the other is the one in Step 5 of branch(Pi, . . . ,Pp). 
The first choice implies that branch(Pi, . . . , Pp) is called A;*^*^^^ times (recali that 
\V{Gr)\ = 0{k)). Each caU of branch(Pi, ...,Pp) has \A'\ < 2k recursive calls 
and the depth of the recursion is upper bounded by 2k, therefore the size of 
the search tree is bounded by k'^^^\ Summing up, we have that /c- Triangle 
Packing is in 2'^('='°s'=) • n-FPT. 

The greedy localization technique has been used to solve a wide variety of 
problems. It was applied for the standard parameterizations of problems such 
as r-DiMENSiONAL Matching in [65], t-Set Packing in |199j . ÌJ-Graph 
Packing in [140j . Also, similar ideas, combined with other techniques, have 
been used for various problems such as the (long-standing open) Directed 
Feedback Vertex Set [70] by and others such as the Bounded Length 
Edge Disjoint Paths in [176j . The main drawback of this method is that the 
parameter dependence of the derived FPT- algorithm is typically 2'^('^^°s'=), 

4.1-3. Finite automata and sets of characteristics 

We proceed now with a more elaborate use of nondeterminism in the design 
of parameterized algorithms. The problem that will drive our presentation is 
the following: 

fc-CUTWIDTH 

Instance: A graph G and a non- negative integer k. 
Parameter: k. 

Question: Does G have cutwidth at most k? i.e., is there a vertex layout 
L = {vi, . . . , Vn} of G such that for every i £ {0, . . . , n} the number of edges of 
G with one endpoint in {vi, . . . , Vi} and one in {wj+i, . . . , Vn} is at most k? 

In what follows we denote the cutwidth of a graph G by cw(G). This prob- 
lem belongs to the category of layout problems and the technique we present ap- 
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plies to many of them. The standard approach uses the parameter of pathwidth 
defined as follows. Given a graph G, we say that a sequence X = {Xi, . . . ,Xr) 
of vertex sets from G is a path decampo sition of G if every vertex or edge of G 
belongs entirely in some Xi and if for every vertex v G G the set {i \ v G Xi} is 
a set of consecutive indices from { 1 , . . . , r} . The width of a path-decomposition 
is equal to max{|Xj| — 1 | i = l,...,r}. The pathwidth of a graph is the 
minimum k for which G has a path-decomposition of width at most k. It fol- 
lows from the results in |34 | HOl H2] that the following problem is in /(/e) -n-FPT: 

A;- Pathwidth 

Instance: A graph G and a non- negative integer k. 
Parameter: k. 

Question: Does G have pathwidth at most k? 

Moreover, the aforementioned FPT-algorithm for A;-Pathwidth is able to con- 
struct the corresponding path-decomposition, in case of a positive answer. 

The design of an FPT-algorithm for fc-CuTWiDTH will be reduced to the 
design of an FPT-algorithm for the following problem. 

pw-k-CvTWiDTn 

Instance: A graph G of pathwidth < / and a non- negative integer k. 
Parameter: k + 1. 

Question: Does G have cutwidth at most k? 

An FPT-algorithm for pw-k-CvTWiBTH is based on the construction, for 
any k,l > 0, of a non-deterministic finite state automaton that receives G as a 
word encoded in terms of a path decomposition of width at most / and decides 
whether a graph G has cutwidth at most k. The number of states of this 
automaton depends exclusively on the parameters k and l and, of course, this 
is also the case when we revert it to a deterministic one. Before we proceed 
with the definition of the automaton we need some more definitions. 

A path decomposition is nice if |Xi| = 1, and for every i S {2, . . . ,r}, the 
symmetric difference of and Xi contains only one vertex. Moreover, if this 
vertex belongs to Xi we cali it insert vertex for Xi and if it belongs to Xi-i we 
cali it forget vertex for Xi. Given a nice path decomposition X = {Xi, . . . , Xr) 
of G of width at most /, it is easy to construct an {l + l)-coloring X ■ ^ ^ 
1} ofG such that vertices in the same Xi have always distinct colors 
(we refer to these colors using bold characters) . If Xi has an introduce vertex 
then set p{i) := ins(t, S) where {t} = x{Xi - and S = XÌ^G[x,^i]iv)) 

(if i = 1 then S = 0). If Xj has a forget vertex then set p(i) := del(t) where 
{t} = x{Xi-i — Xi). We encode X as a string w{X) whose i-th letter is p{i), 
i = l,...,r. 

Let S be an alphabet consisting of ali possible ins(u, 5*) and del{v) (notice 
that the size of E depends only on /) and denote K = {0, . . . ,k}. We also set 
up a set of labels T = {— , 1, . . . , 1 + 1} where bold numbers represent colors 
and "— " represents the absence of a vertex. 

We define the automaton = {Q,Ti,5,qs, F) that receives 'w{X) as 
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input (provided that a path decomposition X of G is given). We set 



Q = {w I w G KCTK)* , \w\ < 2n+l, and each label of T appears at most once in w}, 

Qs = [0], F = {w £ Q \ w = 2n + 1} , and for any q = notinit2 • • • t^n^ G Q 
and ins(t, S) G S or del(t) G S, the value of the transition function 6 is defined 
as foUows: 

6{q, ins(t, S)) = {q' \ q' = n'^t'^n'it^ ■ ■ ■ t^_,_;^n',^]^ where q' £ Q 

and 3j^o<j<r : '^h=i,...,i't'h = '^h ^ t^+i = t A yh=i+i,...,i^'h+i = ^ 
Vft=i,...,i< = nh + \{tj I tj G S A j < A 
^h=j+i,...,r+in'h = nh+i + \{tj I tj G S A j > h}\} 

and 

(5(C, del(t)) = {C' \ C' = notinit2 • • ■ rii-i—rii ■ ■ ■ tr+irir+i 
where t = tj} 

In the definition of 5{q, ins(t, S)), ^G,z,fc guesses the position i where the ver- 
tex colored by t is being inserted in the already guessed layout. Bodlaender, 
Fellows, and Thihkos proved the following in |37j . 

Lemma 4.1. Let G = {y,E) he a graph and X he a path decomposition of G 
of width < l. Then cw(G) < k iff w{X) G \-{AG,i,k)- 

In the above lemma, \-{A) is the language recognized by the automaton A. 
Notice that in A^i^k the definition of 6 does not require any knowledge of G. 
This is because the adjacency information codified in the string 'w{X) is enough 
for the definition of 6. However, the number |Q| of the states stili depends on 
the size of G. To explain how this problem can be overcome we give an example. 

Suppose we have a substring 54—7—92 in some state of Q. Then notice the 
following: If the automaton accepts the string w{X) and during its operation 
enters this state and proceeds by "spliting" the number 7 then it will also accept 
the same string if it "splits" instead the number 4. This essentially means 
that it is not a problem if we "forget" 7 from this state. As a consequence 
of this observation, we can reduce the length of the strings in Q by suitably 
"compressing" them (see 001 SU [2711 EZU ) ■ To explain this we first need 
some definitions. 

Let w £ Q. We say that ci Z IS ci portion of w if it is a maximal substring 
of w that does not contain symbols from T. We say that a portion of w is 
compressed if it does not contain a sub-sequence ni— «2— na such that either 
ni < n2 < or ni > n2 > n^. The operation of replacing in a portion any 
such a subsequence by ni—n^ is called compression of the portion. We also cali 
compression of w G Q the string that appears if we compress ali portions of 
w. We define Q as the set occurring from Q if we replace each of its strings by 
their compressions. This replacement naturally defines an equivalence class in 
Q where two strings are equivalent if they have the same compression. That, 
way, Q defines a "set of characteristics^^ of Q in the sense that it contains ali 
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the useful information that an automaton needs in order to operate. The good 
news is that the size of Q is now depending only on / and k. Indeed, in j40l I272j 
it was proved that \Q\ < {l + 1)!|2^*^ and this makes it possible to construct an 
automaton that does not depend on the input graph G. In particular define the 
non-deterministic finite state automaton Aij^ = (Q, E, 5, qs,Q)- Here 6 = f3 o 5 
where /3 is the function that receives a set of members of Q and outputs the set 
of ah their compressions. The following holds: 

Lemma 4.2. Let G = {V,E) he a graph and X he a path decomposition of G 
ofwidth < l. Then cw(G) < k iff w{X) G L(À,fc). 

As mentioned, the construction of the automaton Ài^k depends only on l 
and k. Moreover, as the input is a string of length 0{n) the decision can be 
made non-deterministically in linear time. As for every non-deterministic finite 
state automaton one can construct an equivalent deterministic one (notice that 
the state explosion will be an exponential function on k and /), we deduce the 
following: 

Theorem 4.3. ptD-fc-CuTWiDTH G f{k) ■ n-FPT. 

In |37] Bodlaender, Fellows, and Thilikos described how to turn the decision 
algorithm to an algorithm that, in case of a positive answer, also outputs the 
corresponding layout. 

An FPT-algorithm for fc-CuTWiDTH follows easily from Theorem |4.3| by 
taking into account that if the input graph G has cutwidth at most k then it 
also has a path decomposition of width at most k (see |272] ). Recali that k- 
PATHWIDTH belongs to /(A;)-n-FPT^42j. Using this algorithm, we check whether 
the pathwidth of G is at most k and, in case of a negative answer, we report a 
negative answer for cutwidth as well. Otherwise, the same algorithm outputs a 
path decomposition of G of width at most k. Then we may solve A:-Cutwidth 



by applying the FPT-algorithm of Theorem 4.3 

The above technique is known as the characteristic sequences technique and 
appeared for the first time in [30] (for pathwidth and treewidth) and has further 
been developed in [lOl UH l27H - l274j (for linear-width, branchwidth, cutwidth, 
and carving-width) . Its automata interpretation appeared in |^ and derived 
FPT-algoroithms for weighted and directed variants of pathwidth, cutwidth, 
and modified-cutwidth (see also |264j for a survey) . Finally, an extension of the 
same technique for more general parameters appeared by Berthomé and Nisse 

in m\. 



4-2. Meta-algorithmic techniques 

By the term algorithmic meta-theorem we mean a theorem than provides 
generic conditions concerning the problem itself that enable us to guarantee the 
existence (constructive or not) of an algorithm. In a sense, (constructive) meta- 
algorithmic results provide algorithms that receive as input the problem and 
output an algorithm to solve it. Such results usually require a combinatorial 
condition on the inputs of the problem and a logicai condition on the statement 
of the problem. This is a "dream ideai algorithm-design technique" since we 
automatically obtain an algorithm given just the specification of the problem. 
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We remark that these methods are so general that, in most of the cases, 
they not produce very good algorithms, especially in terms of the constants. 



As we mentioned in Subsection 3.7, sometimes this impracticality is provable. 
Paradoxically, this impracticality is often proved using parameterized complex- 
ity classes like However, at least for Courcelle's Theorem, the methods 

work well for problems of small quantifier depth, and the prìnciple impediment 
here is a really good algorithm for finding tree (or other) decompositions. We 
will also discuss efforts towards speeding up those algorithms in Subsection |4.3[ 
We also remark that the ideas have been applied beyond graphs, for example 
to matrices and matroids via the work of, for example, Petr Hliheny |191j or 
Geelen, Gerards, and Whittle [173] . We do not have the space or expertise to 
present their ideas, and refer the reader to their work for more details. 

4-2.1. Courcelle's theorem 

The logicai condition is related to the Monadic Second Order Logic on 
graphs (MSOL). Its syntax requires an infinite supply of individuai variables, 
usually denoted by lowercase letters x,y,z and an infinite supply of set variables, 
usually denoted by uppercase letters X,Y,Z. 

Monadic second-order formulas in the language of graphs are built up from 

• atomic formulas E{x,y), x = y and X(x) (for set variables X and indi- 
viduai variables x) by using the usuai Boolean connectives (negation), 
A (conjuction), V(disjunction), — )• (implication), and -f-)- (bi-implication) 
and 

• existential quantification 3x, 3X and universal quantification Vx, VX over 
individuai variables and set variables. 

Individuai variables range over vertices of a graph and set variables are 
interpreted by sets of vertices. The atomic formula E{x, y) express adjacency, 
the formula x = y expresses equality and X{x) means that the vertex x is 
contained in the set X. The semantics of the monadic-second order logie are 
defined in the obvious way. As an example of an MSOL property on graphs, 
we give the following formula 

(/) = 3R3Y 3B {^x {{R{x)yY{x)y B{x)) h 

^{R{x) A Y{x)) A ^{B{x) A Y{x)) A -(i?(x) A B{x)))) 
A-i(3a; 3y {E{x,y) A 

{{R{x) A R{y)) V {Y{x) A Y{y)) V {B{x) A B{y))))) 

and observe that G \= (p {G models (p) if and only if G is 3-colorable (the two 
first lines ask for a partition of the vertices of G into three sets R, Y, and B 
and the two last lines ask for the non-existence of an edge between vertices of 
the same part of this partition). 

The second (combinatorial) ingredient we need is a measure of the topolog- 
ical resemblance of a graph to the structure of a tree. 

A branch decomposition of a graph G is a pair (T,t), where T is a ternary 
tree (a tree with vertices of degree one or three) and r is a bijection from 
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E{G) to the set of leaves of T. Clearly, every edge e of T defines a partition 
{t~^{LI),t^^{LI)) of E{G) where, for i = 1,2, L\ contains the leaves of the 
connected components of T \ e. The middle set function mid : E{T) — )• 2^^*^) 
of a branch decomposition maps every edge e of T to the set (caUed mid- 
dle set) containing every vertex of G that is incident both to some edge in 
r^^(Lg) and to some edge in r~^(Lg). The branchwidth of (T, r) is equal to 
maXgg^^j") |niid(e)| and the branchwidth of G, bw(G), is the minimum width 
over ali branch decompositions of G. 

Now we are ready to define the following parameterized meta-problem. 



bw-(j)-MODEL ChECKING FOR (f) 

Instance: A graph G. 
Parameter: bw(G) + 
Question: G |= </>? 



At this point we must stress that branchwidth can be interchanged with its 
"twin" parameter of treewidth, tw(G), for most of their applications in param- 
eterized algorithm design. The reason is that for every graph G, it holds that 
bw(G') < tw(G) + 1 < Ìbw(G), where by tw(G) we denote the treewidth of 
G |254) ■ Therefore, there is not much difference in the bw-cp-MODEh Checking 
FOR (j) problem if we use treewidth instead of branchwidth 

We can now present the following meta-algorithmic result proved by Cour- 
celle. 

Theorem 4.4 (Courcelle's Theorem [79]). // (/) is an MSOL formula, then 
bw-cp-MODEh Checking for (p belongs to 0{f{k, |0|) • n)-FPT. 

A proof of the above theorem can be found in \125\ Chapter 6.5] and |155| 
Chapter 10] and similar results appeared by Arnborg, Lagergren, and Seese 
in ^21j and Borie, Parker, and Tovey in |45j. Also, an alternative game theoretic- 



proof has appeared recently in [208^ I215j . In fact, Theorem 4.4 holds also for 
the more general monadic second order logie, namely MSOL2, where apart from 
quantification over vertex sets we also permit quantification over edge sets. It 
also has numerous generalizations for other extensions of MSOL (see \80\ [8H 



Theorem 4.4 and its extensions can be applied to a very wide family 
of problems due to the expressibility power of MSOL. As a general principle, 
"most normal" problems in NP can be expressed in MSOL2, and hence they 
are classified in FPT for graphs of bounded width. 

However, there are stili graph problems that remain parameterized-intractable 
even when parameterized in terms of the branchwidth of their inputs. As ex- 
amples, we mention List Colorino, Equitable Colorino, Precoloring 
ExTENSiON |144j . and Bounded Length Edge-Disjoint Paths |174j . 



In [82j . Courcelle, Makowski, and Rotics extended Theorem 4.4 for the more 
general parameter of rankwidth (see also [214j). The definition of rankwidth 
is quite similar to the one of branch-width: a rank decomposition of a graph 
G is again a pair (T, r) with the difference that now r is a bijection from 
V{G) to the set of leaves of T. For each edge e of T, the partition {Vj^, V^) = 
(r^-'^(Lg), r^^(Lg)) is a partition of V{G) which, in turn, defines a \V^\ x \V^\ 
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matrix Mg over the field GF{2) with entries ax,y for [x, y) ^ x where 
Ux^y = 1 if {x,y} G E{G), otherwise a^^y = 0. The rank-order p{e) of e is 
defìned as the row rank of Mg. Similarly to the definition of branch-width, the 
rankwidth of {T,t) is equal to maXeg^;^^') |p(e)| and the rankwidth of G, rw(G), 
is the minimum width over ah rank decompositions of G. Rank-width is a more 
general parameter than branchwidth in the sense that there exists a functìon / 
were bw(G) < /(rw(G)) for every graph G, as proved by Oum and Seymour 
in [2ii] . 

Consider now the following parameterized meta-problem. 



™-(/)-MODEL ChECKING FOR (j) 

Instance: A graph G. 
Parameter: rw(G) + 
Question: G |= (pi 



We can now present the following extension of Theorem 4.4 



Theorem 4.5 (Courcelle, Makowski, and Rotics [82j). If (p is an MSOL for- 
mula, then rw-cp-MOBEh Checking por (p belongs to 0{f{k, \(p\) ■ n)-FPT. 



Actually the originai statement of Theorem 4.5 used yet another width met- 
ric, called cliquewidth, instead of rankwidth. However, we avoid the definition 
of cliquewidth and we use rankwidth instead, in order to maintan uniformity 
with the definition of branchwidth. In what concerns the statement of the the- 
orem, this makes no difference as rankwidth and cliquewidth are parametrically 
equivalent: as proved in [244j, for every graph G, rw(G) < clw(G) < 2^^('=^)-l 
(where clw(G) is the cliquewidth of G). 



It is interesting to observe that Theorem 4.5 is not expected to hold for 
MSOL2 formulas. Indeed, Fomin, Golovach, Lokshtanov, and Saurabh, proved 
in |159j that there are problems, such as Graph Coloring, Edge Dominat- 
ING Set, and Hamiltonian Cycle that can be expressed in MSOL2 but not in 
MSOL, that are W[l]-hard for graphs of bounded cliquewidth (or rankwidth). 

4.2.2. FPT and FOL 

While the parameterized tractability horizon of MSOL-expressible problems 
is restricted to graphs of bounded branchwidth, one can do much more for prob- 
lems that can be expressed in First Order Logic (FOL). First Order formulas 
are defined similarly to MSOL formulas with the (essential) restriction that no 
quantification on sets of variables is permitted any more. A typical example of 
a parameterized FOL-formula is the following: 

= ■■■^xki A Xiy^XjA\/y y {y = XiV E{y,Xi))) 
i<i<j<k ie{i,...,fe} 

The formula (j)k expresses the fact that G has a dominating set of size k. 



Let C be a class of graphs. We consider the following parameterized meta- 
problem. 



43 



(^-MODEL ChECKING FOR FOL IN C 

Instance: A graph G G C and a FOL-formula 4>. 
Parameter: \(j)\. 
Question: G |= </>? 

A graph H is a minor of a graph G, we denote it by H <^ G, if there exists 
a partial function a : V{G) — )• V{H) that is surjective and such that 

a) for each a G V{H), G[a~^{a)\ is connected and 

b) for each edge {a, 6} G E{H) there exists an edge {x, y} G -E'(G) such that 
X G (T~-'^(a) and y G cr^^(ò). 

Given a graph H we say that a graph class G is H -minor free if none of the 
graphs in G contain H as a minor. Intuitively, H ìs a minor G if H can be 
obtained from a subgraph of G after applying a (possibly empty) sequence of 
edge contractions. 

If in the definition of the minor relation we further restrict each G[a^^{a)] 
io have radius at most r, for some r G N, then we say that H ìs a r-shallow 
minor of G and we denote it by H <^ G. 

The grad (greatest reduced average density) of rank r of a graph G is equal 
to the maximum average density over ali r-shallow minors of G and is denoted 
by Vr(G'). We say that a graph class G has bounded expansion if there exists a 
function / : N — 7- M"^ such that Vr(G) < /(r) for every integer r > and for 
every graph in G ■ The notion of bounded expansion was introduced by Nesetf il 
and Ossona de Mendez in |235j and was studied in |237H239] . Examples of 
classes of graphs with bounded expansion include proper minor-closed classes 
of graph^ classes of graphs with bounded maximum degree, classes of graphs 
excluding a subdivision of a fixed graph, classes of graphs that can be embedded 
on a fixed surface with bounded number of crossings per each edge and many 
others (see |236j ). Many meta-algorithmic results from proper minor-closed 
classes of graphs to classes of graphs with bounded expansion, see [87 1 11351 1178| 
11791 1213] . These include the classes of graphs of bounded locai treewidth. The 
reader will recali that a class of graphs C of graphs has bounded locai treewidth 
iff there a function / such that for ali graphs G £ C and ali vertices v G y{G) 
the neighbourhood of v of distance k from v has treewidth f{k). 

The following theorem was proved by Dvorak, Kral, and Thomas in [136j and 
is one of the most general meta-algorithmic results in parameterized complexity. 

Theorem 4.6. If G is a graph class of bounded expansion, then 0-Model 
Checking for FOL IN C belongs to FPT. In particular, there exists a com- 
putable function / : N — t- N and an algorithm that, given a n-vertex graph G £ G 
and a FOL-formula (f) as input, decides whether G \= (j) in f{\(j)\) ■ n steps. 

Actually, there is an extension of the above for the even more general case 
where G has locally bounded expansion, that is there exists a function / : NxN — >• 



''A graph class Q is (proper) minor-closed if it (does not contain ali graphs and) is closed 
under taking minors. 
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such that Vr(G) < f{d,r) for every integer r > and for every graph that 
is a subgraph of the d-neighborhood of a vertex of a graph from in Q. In this 
case, according to |136| . the algorithm runs in f ■ n^'^'' steps, for every e > 0. 

4.2.3. Graph Minor s 

The Graph Minor Theory has been developed by Robertson and Seymour 
towards proving the long-standing Wagner's Conjecture: graphs are well quasi- 



ordered under the minor relation (see Theorem 4.8 below). The contribution 
of the results and the methodologies derived by this theory to the design and 
analysis of parameterized algorithms, was fundamental. In this subjection and 
the next one we present some of the main contributions in this direction. 

A graph parameter is a recursive function p mapping graphs to non- negative 
integers. A graph parameter p is minor- do s ed il H <m G imphes p{H) < p{G). 
Given a graph parameter p and A; > 0, we define its k-th obstruction obs(p, k) 
as the set of ali minor- minimal graphs of the set {G \ p(G) > k}. The following 
lemma is a direct consequence of the definitions. 

Lemma 4.7. Ifp is a minor-closed parameter p and G is a graph, then p{G) < 
k if and only if none of the graphs in obs(p, k) is a minor of G. 

The following theorem is one of the deepest results in Graph theory and 
was the main result of the Graph Minor series of Robertson and Seymour. 

Theorem 4.8 (Robertson and Seymour theorem - |257| ). Every infinite se- 
quence of graphs contains two distinct elements Gì, Gj such that Gì <m Gj. 

By definition, the graphs in obs(p, k) are incomparable with respect to the 
minor relation. Therefore, a direct corollary of Theorem |4.8| is the following. 

CoroUary 4.9. obs(p, k) is finite for every parameter p and k >0. 

Part of the Graph Minors series was the study of the parameterized com- 
plexity of the following problem and its generalizations. 

iJ-MiNOR ChECKING 

Instance: Two graphs G and H. 
Parameter: k = \ V{H)\. 
Questioni Is H a minor of GÌ 

Theorem 4.10 (Robertson and Sevmour [255j ). iZ-MiNOR Checking G f{k) ■ 
n^-FPT. 

To demonstrate the importance of the above results to FPT-algorithm de- 
sign, we consider the following meta-problem. 

A;-Parameter Checking for p 
Instance: a graph G and an integer /e > 0. 
Parameter: k 
Question: p(G)< kl 



It is now easy to check that Lemma 4.7, Corollary 4.9 and Theorem 4.10 
imply the following meta-algorithmic theorem. 
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Theorem 4.11. If p is a minor-closed graph parameter, then A;-Parameter 
Checking por p helongs to f{k) ■ n^-FPT. 



Notice that the above theorem imphes the existence of an FPT-algorithm for 
A;- Parameter Checking por p and not its constructibiHty. The construction 
of the algorithm for some specific parameter p is possible only when obs(p, k) 
can be constructed for ah k > 0. Moreover, the general problem of computing 
obs(p, k) is not recursively solvable, as has been noticed in (147j (see also 
|277| ): see also the results of Friedman, Robertson, and Seymour |171] on the 
non-constructibility of the Robertson and Seymour theorem. 



Our first example of the applicabili ty of Theorem 4.11 concerns Vertex 
Cover. We define vc(G) as the minimum size of a vertex cover in G. Notice 
that ve is minor-closed and therefore, Theorem |4 . 1 1 1 can be applied. Moreover, 
in |106j . Dinneen and Lai proved that each graph in obs(p, fc) has at most 
2k + 1 vertices and this implies the constructibility of obs(p, k) for a given 
k: just enumerate ali graphs of at most 2k + 1 vertices and filter those that 
are minor minimal. As a consequence, we can construct an FPT-algorithm for 
Vertex Cover. 

Our next example concerns the following problem. 

A;- Vertex Feedback Set 

Instance: A graph G and an integer k > 1. 

Parameter: k 

Question: Does G contain a feedback vertex set of size < k (i.e., a set of at 
most k vertices meeting ali its cycles)? 

We define fvs(G) as the minimum size of a feedback vertex set of G. It 
is easy to observe that fvs is minor-closed, therefore /e- Vertex Feedback 
Set belongs to FPT. Unfortunately, this approach is not able to construct the 
algorithm as there is no known upper bound on the size of obs(fvs, k) for ali 
k > 3 (for A; = 0, 1, 2, obs(fvs, k) has been found in [105j ). To make the result 
constructive, we need some more results. 

We cali a parameter p treewidth-bounded, if tw(G) < /(p(G)) for some 
recursive function /. We also cali p MSOL-definable if, for every k > 0, the 
class of graphs {G \ p{G) < k} is definable by an MSOL formula (j)k (the length 
of the formula depends on k). The following lemma was proved by Adler, Grohe, 
and Kreutzer in (see also [55]). 

Lemma 4.12. If p is a parameter that is MSOL-definable and treewidth- 
bounded, then obs(p, A) < f{k) for some recursive function f . 



Lemma |4.12| and Theorem |4.11 imply the following: 



CoroUary 4.13. If p is a treewidth-bounded minor-closed graph parameter, 
then A-Parameter Checking por p is constructively in f{k) ■ n-FPT. 

It is easy to observe that tw(G) < fvs(G). Therefore, Corollary 4.13 implies 
that one may construct an algorithm computing obs(fvs, k) and this, in turn. 
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implies that one can construct an FPT-algorithm for Feedback Vertex Set. 



Our next example is more complicateci. A planar graph H is a k-fold planar 
cover of a graph G if there is a surjection x ■ ^(H) — >■ ViG) such that 

• for every e = {x,y} G E{H), {x{x),x{y)} G E{G). 

• for every v £ V{H), the restriction of x to the neighbors of f is a bijection. 

• for every u £ V{G), \x~^{'^)\ ^ ^• 

We consider the following parameterized problem. 

^-Planar Cover 

Instance: A graph G and an integer fc > 1. 
Parameter: k 

Question: Does G have a k-iold planar cover? 

Let cov(G) be the minimum k for which G has a /c-fold planar cover. For 
completeness we set cov(G) = oo if such a cover does not exists. It is easy to 



observe (see e.g. [5j) that cov(G) is minor-closed, therefore, from Theorem 4.11 
/c-Planar Cover G FPT. However this result stili remains non-constructive 
as, so far, there is no known procedure to construct obs(cov, k) for k > 1. 

A more general theorem on the constructibility horizon of the obstruction 
sets is the following. 

Theorem 4.14 (Adler, Grohe, and Kreutzer [6]). There is an algorithm that, 
given two classes Ci, C2 of finite graphs represented by their obstruction sets 
obs(Ci) and obs(C2), computes the set of excluded minor s for the union C = 
C1UC2. 

The above theorem, can be useful for making the meta-algorithm of Theo- 
rem 4.11 constructive. For this consider two graph parameters pi and p2. We 



define the union of pi and p2 as the parameter p where p(G) = max{pi(G), P2(G)}. 



A direct consequence of Theorem 4.14 is the following: 



CoroUary 4.15. Letpi andp2 be minor-closed parameters for which k-PARAMETER 
Checking for Pi is constructively in FPT fori = 1, 2. Then the A;-Parameter 
Checking por p is also constructively in FPT, where p is the union o/pi and 

P2. 

An interesting problem is to extend as much as possible the collection of 
parameters where Corollary 4.15| can be made constructive. Another running 



project is to find (when possible) counterparts of the algorithm of Theorem 4.10 
for other partial relations on graphs. An important step in this direction was 
done by Grohe, Kawarabayashi, Marx, and WoUan [180] for the relations of 
topological minor and immersion. 
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4 -2. 4- The irrelevant vertex technique 

One of the most important contributions of the Graph Minors project to pa- 
rameterized algorithm design was the proof, in [256J , that the fonowing problem 
is in f(k) -n^-FPT (a faster, f{k) -v? step algorithm appeared recently in |202j ). 

A;-DISJOINT Paths 

Instance: A graph G with k pairs of terminals T = {{si, ti), ... , (s^, tk)} G 
y(G')2(fc). 

Parameter: k 

Questioni Are there k pairwise vertex disjoint paths Pi, . . . , in G such that 
Pi has endpoints Si and tj? 

The algorithm for the above problem is based on an idea known as the 
irrelevant vertex technique and revealed strong links between structural graph 
theory and parameterized algorithms. In general the idea is described as follows. 

Let (G, T) be an input of the A;-disjoint Paths. We say that a vertex 
V G V{G) is solution-irrelevant when (G, T) is a YES-instance if only if {G\v, T) 
is a YES-instance. If the input graph G violates some structural condition, then 
it is possible to find a vertex v that is solution-irrelevant. One then repeatedly 
removes such vertices until the structural condition is met which means that 
the graph has been simplified and a solution is easier to be found. 

The structural conditions used the in algorithm from |256| are two: 

(i) G excludes a clique, whose size depends on /e, as a minor and 

(ii) G has treewidth bounded by some function of k. 

In |256j Robertson and Seymour proved, for some specific function /i : N — N, 
that if the input graph G contains some K^j^-j as a minor, then G contains some 
solution-irrelevant vertex that can be found in h{k) ■ r? steps. This permits us 
to assume that every input of the problem is i^/j(fc)-minor free, thus enforcing 
structural condition (i). Of course, such graphs may stili be complicated enough 
and do not necessarily meet condition (ii). Using a series of (highly non-trivial) 
structural results |25Ul I25l] . Robertson and Seymour proved that there is some 
function g( : N — )• N such that every -minor free graph with treewidth at 
least g(}i) contains a solution-irrelevant vertex that can be found in g(ìi) ■ v? 
steps. This enforces structural property (ii) and then fc-DiSJOiNT Paths can 



be solved in /(fc) • n steps, using Courcelle's theorem (Theorem 4.4). 

Actually the above idea was used in |256j to solve a more general prob- 
lem that contains both A:-disjoint Paths and /f-MiNOR Checking. The only 
"drawback" of this algorithm is that its parametric dependence, i.e., the func- 
tion / is immense. Towards lowering the contribution of /, better combinatoria! 
bounds where provided by Kawarabayashi and Wollan in |205j . Also, for planar 
graphs a better upper bound was given in [7J. The irrelevant vertex technique 
has been used extensively in parameterized algorithm design. For a sample of 
results that use this technique, see [871 EHI 113 M [2031 [2011 [209]. 
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4-3. Faster fPT -algorithms 

Clearly the FPT-algorithms presented in the previous subsection are far 
from being practical as their parameter dependence may be huge. A big part 
of research has been devoted to the reduction of their parameter dependence or 
at least to the detection of classes of their instances where such a simphfication 
is possible. 

4.3.1. Dynamic Programming 



While the parameter dependence of the algorithms derived by Theorem 4.4 
are huge (see |170j ). they usually can be considerably improved with the use of 
dynamic programming. In what fohows, we describe the general approach and 
provide two simple examples. 

Suppose that G is a graph and let (T, r) be a branch decomposition of it 
of width at most k. For applying dynamic programming on (T, r) we consider 
the tree T to be rooted at one of its leaves. Let be this leaf and let be the 
edge of T that contains it. Also, we slightly enhance the definition of a branch 
decomposition so that no edge of G is assigned to Vr and thus mid(er) = 
(for this, we take any edge of the branch decomposition, subdivide it and then 
connect the subdivision vertex with a new (root) leaf tr, using the edge Cr). The 
edges of T can be oriented towards the root Cr, and for each edge e G E{T) we 
denote by Ee the edges of G that are mapped to leaves of T that are descendants 
of e. We also set Ge = G[Ee] and we denote by L{T) the edges of T that are 
incident to leaves of T that are different than Vr. Given an edge e heading at a 
non-leaf vertex v, we denote by ei, cr S E{T) the two edges with tail v. 

We give two examples. We first present how to to do dynamic programming 
for solving the following problem. 

òif- Vertex Cover 

Instance: A graph G and a non-negative integer i. 
Parameter: k = bw(G). 

Question: Does G have a vertex set S of size at most i that intersects ali the 
edges of G? 

Let G be a graph and X, X' C V{G) where X n X' = 0. We say that 
vc{G, X, X') < i ìf G contains a vertex cover S where IS] < £ and X Q S CI 
V{G) \ X'. Let 

7^e = {{X,i)\X C mid(e) and vc(Ge, X, mid(e) \X) <i}. 

The set TZe book-keeps ali pairs {X, £) certifying the existence, in Gg, of a vertex 
cover of size < i whose restriction in mid(e) is X. Observe that vc(G) < i 
iff (0,^) G Tlcr- For each e £ E{T) we can compute TZe by using the following 
dynamic programming formula: 



'{{X,e) \ XQeandX^$A£> \X\} if e G L(T) 
{{X,i) I 3{Xi,h) G ne„3{X2,Ì2) G TZe, : 

{Xi U X2) n mid(e) = X A£i + Ì2-\XinX2\ <£} if e L(T) 
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Note that for each e G E{T), |7^e| < 2l'"''*(«)l • i. Therefore, the above algo- 
rithm can check whether vc(G) < ^ in 0(4^^(<5) • . \V{T)\) steps. Using the 
fact that every n-vertex graph has at most 0(bw(G) • n) edges, we obtain that 
|y(T)| = 0(bw(G) ■ n). As l < n, the above dynamic programming algorithm 
imphes that òw-Vertex Cover belongs to 2*^^*^) • n^-FPT. 

Our second example is a dynamic programming algorithm for the foUowing 
problemi 



6u;-3-COLORlNG 

Instance: A graph G. 

Parameter: k = bw(G). 

Question: Does G have a proper 3-coloring? 



We will consider 3-coloring functions of the type x '■ S ^ {1,2, 3} and, for 
S' C S, we use the notation x\s'= {(«j 9) ^ X I a G S'} and x(-S") = {xÌq) | Q € 
S'}. 

Given a rooted branch decomposition (T, r) an edge e G V{T), we use the 
notation for ali functions x ■ mid(e) — >■ {1, 2, 3} and the notation Xe for ali 
proper 3-colorings of Gè- We define 



= {X e I 3x G -^e : X |mid{e)= X} 



The set «e stores the restrictions in mid(e) of ali proper 3-colorings of Gg. 
Notice that for each e G E{T), \ae\ < 3™'^(^) < 3*^ and observe that G has a 
3-coloring iff ^ (if «e 7^ 0) then it contains the cmpty function). For each 

e G E{T) we can compute TZe by using the foUowing dynamic programming 
formula: 

'{xG^el |x(e)|=2} ifeGL(r) 

XL|mid{ei)nmid(efl)= X-R|mid(ez,)nmid(eH) ^'^'^ 

^ iXL U Xfi)|mid(e)= X} if e L{T) 

Clearly, this simple algorithm proves that 6w-3-COLORlNG belongs to 2^^^^ ■ 
n-FPT. A straightforward extension implies that òw-q-COLORiNG belongs to 

In both above examples, we associate to each edge e G ^^(r) some char- 
acteristic structure, that, in case of òw-Vertex Cover and Òiu-S-COLORING, 
is TZe and respectively. This structure is designed so that its valuc for Cr 
is able to determine the answer to the problem. Then, it remains to give this 
structure for the leafs of T and then provide a recursive procedure to com- 
pute bottom-up ali characteristic structures from the leaves to the root. This 
dynamic programming machinery has been uscd many times in parameterized 
algorithm design and for much more complicated types of problems. In this 
direction, the algorithmic challenge is to reduce as much as possible the Infor- 
mation that is book-kept in the characteristic structure associated to each edge 
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of T. Usually, for simple problems as those examined above, where the struc- 
ture encodes subsets (or a bounded number of subsets) of mid(e), it is easy to 
achieve a single-exponential parametric dependence. Typical examples of such 
problems are DOMINATING Set, Max Cut and Independent Set, param- 
eterized by treewidth/branchwidth, where the chahenge is to reduce as much 
as possible the Constant hidden in the O-notation of their 2*^('^^-parameter de- 
pendenc^ Apart from tailor-made improvements for specific problems such as 
tw-DOMiNATiNG Set and ft(;-VERTEX Cover (see e.g. pTOl fT2l, [28] ) , substantial 
progress in this direction has been done using the Fast Matrix Multiphcation 
technique, introduced by Dorn in |109j and the results of Rooij, Bodlaender, 
and Rossmanith in |279j . where they used the Generahzed Subset Convolution 
Technique (introduced by of Bjòrklund, Husfeldt, Kaski, and Koivisto in [29]). 

Recently, some lower bounds on the parameterized complexity of problems 
parameterized by treewidth were given by Lokshtanov, Marx, and Saurabh 
in 1220]. According to [220], unless SAT is solvable in 0*((2 - 5)") steps, 
òw-Independent-Set does not belong to (2 — e)*^ • n'^(^)-FPT, òw-Max Cut 
does not belong to (3 — e)*^ • n'^^^^-FPT, òiì;-Dominating-Set does not belong 
to (3 - e)'^ • n'-'(^)-FPT, 6w-0dd Cycle Transversal does not belong to 
(3 — e)^ ■ n'^(^)-FPT, and òtD-q-COLORiNG does not belong to {q — e)^ • n'^(^)- 
FPT. The assumption that SAT 0*((2 - (5)")-TIME, is known as the Strong 
Exponential Time Hypothesis (SETH) and was introduced by Impagliazzo and 
Paturi in [195]. 

For more complicated problems, where the characteristic encodes pairings, 
partitions, or packings of mid(e) the parametric dependence of the known 
FPT algorithms is of the type 2*-^('^'°§'^) • n'-^^^^ or worst. Usually, these are 
problems involving some global constraint such as connectivity on the certifi- 
cate of their solution. Recent complexity results of Lokshtanov, Marx, and 
Saurabh [221] show that for problems such as the DiSJOiNT Paths Problem 
no 2°^*'''°^^) •n'^(^)-algorithm exists unless ETH fails. On the other hand, a tech- 
nique was recently introduced by Cygan, Nederlof, M. Pilipczuk, M. Pilipczuk, 
van Rooij, and Wojtaszczyk in [85], solved many problems of this type in 
20(tw(G)) . ^0{n) g^gpg ]-,y raudomizcd Monte Carlo algorithms. This includes 
problem as Hamiltomian Path, Feedback Vertex Set and Connected 
DOMINATING Set. For planar graphs it is stili possible to design 0*{2^'^'"'>) 
step dynamic programming algorithms using the the Catalan structures tech- 
nique introduced by Dorn, Penninkx, Bodlaender, and Fomin in |115j. This 
technique uses a special type of branch decomposition called sphere cut decom- 
positions introduced in |265j . In such decompositions, the vertices of mid(e) 
are virtually arranged on a closed curve of the surface where the input graph is 
embedded. In case the characteristic structure encodes non-crossing pairings, 
its size is proportional to the k-th Catalan number that is single-exponential in 
k. This fact yields the O* {2'-'^^^^) time bound to the corresponding dynamic 
programming algorithms. The same technique was extended by Dorn, Fomin, 
and Thilikos in |112j for bounded genus graphs and in |113j for every graph class 



'^As here we care about the exact parameter dependence the constants may vary depending 
on whether we parameterize by treewidth or branchwidth. 
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that excludes some graph as a minor. Finally, Rué, Sau, and Thilikos in [259j 
extended this technique to wider families of problems. 



4-3.2. Single- Exponential Algorithms 

In [54J Cai and Juedes proved that /c-Vertex Cover cannot be solved 
steps unless ETH collapses. The Hnear parameter dependence 
of the standard reductions from /c-Vertex Cover to other problems such as 
/c-DoMiNATiNG Set or /c-Feedback Vertex Set imply that the same lower 
bound holds for these problems as well. In other words, for a wide class of pa- 
rameterized problems membership in the parameterized class EPT (containing 



ali problems solvable in 2*^^^^ • n*^*-^^ steps as defined in Subsection 3.11) is the 
best we may expect. However, to prove membership in EPT is not always easy. 
In fact none of the the techniques described so far guarantees that the derived 
algorithms will have single-exponential parameter dependence. We describe two 
general techniques that yield such bounds. 

Iterative compression. . As a technique, iterative compression dates back to the 
parameterized algorithm given by Reed, Smith, and Vetta in |249j for the prob- 
lem Odd Cycle Transversal that, given a graph G and an integer k, asks 
whether there is a set S of at most k vertices meeting ali odd cycles of G (see 
also |192j ). Before |249j . this was a popular open problem and iterative com- 
pression appeared to be just the correct approach for its solution. In what 
follows we will give a generic example of this technique. Let II be a graph 
property that is hereditary i.e., if H is an induced subgraph of G and G G II, 
then also H We define the following meta-problem: 

/c- Vertex Deletion Distance From n 
Instance: A graph G and a non- negative integer k. 
Parameter: k. 

Question: Is there an S C V{G) of size at most k such that G — S G II? (Here 
we denote hy G - S the graph G[V{G)\S].) 

Our intention is to solve this problem for several choices of II. Clearly, if 
n is "being edgeless", the above problem is Vertex Cover. Also, if II is 
"being acyclic" the above problem defines Feedback Vertex Set, while if II 
is "being bipartite", it defines Odd Cycle Transversal. In fact, iterative 
compression reduces algorithmically the problem to its annotated version below 
with the additional restrictions that (a) H[Q] G U and (b) H — Q G H. 

A;- Annotated Vertex Deletion Distance From n 

Instance: A graph H, a set Q C V(H), and a non-negative integer k. 

Parameter: k. 

Question: Does H have a vertex set R C V{II) of size at most k such that 
RQQ and H - ReU? 

We now present the following routine that, given a graph G and a non- 
negative integer k, returns either a vertex cover S of size at most k or NO which 
means that no such solution exists. 
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Procedure solveVDDn(G, k) 

1. If V{G) = ili, then return 5 = 0. 

2. Pick a vertex v £ ViG) and 

if solveVDDn(G - v, k) =N0, then return NO. 

3. let S = solveVDDn(G -v,k)U {v}. 

4. If l^l < A; then return S. 

5. for ali F C 5 such that G[F] G H, 

let Q = V{G) -S, H = G[F U Q], k' = k - \S - F\, and check whether 
the /c-Annotated Vertex Deletion Distance From n 
with input H, Q, and k' has a solution R where R Q. 
If this solution R exists, then return RU {S — F). 

6. return NO 

The above procedure considers a vertex ordering (vi, . . . ,Vn) of G and solves 
the problem by considering the graphs Gì = G[{1, . . . ,i}], i = 0, . . . ,n. If 
i = 0, then, as returned in line 2, the empty set is a solution. Assume now 
that a solution S' for Gì is known, which, by the hereditarity of II, implies 
that S = S' U {vi+i} is a solution for Gj+i of size < A; + 1. If \S\ < k, then 
5 is a solution also for Gì, as is decided in Step 4. In Step 5 the algorithm 
is trying to find a solution in G that does not intersect F C S" and contains 
S — F for ali possible 2^"^^ choices of F. Certainly, this is not possible if 
H — Q = G[F] n as indicated by the filtering condition of this loop. In what 
remains, one has to solve the annotated version of the problem of H and for k' 
with Q as annotated set. To find such a solution one may use the additional 
properties that H — Q £ U and H[Q] £ Il (recali that Q = V{G) — S which 
means that H[Q] = G[Q] E II). From now on, the technique is specialized to 
each particular problem. For instance, for Vertex Cover, the graph H is 
a bipartite graph with parts F and Q. The question is whether some subset 
R,\R\ < k' of Q meets ali the edges of H, which essentially asks whether the 
non-isolated vertices of Q are at most k' . As this can be decided is polynomial 
time, the only non-polynomial load of the whole procedure is the one of Step 5, 
and this yields an 0{2^ -n^) step algorithm. The analogous question for the case 
of Feedback Vertex Set needs more effort as now F and Q induce forests 
in H. In [90 1 1183] . it was shown that the annotated version of the Feedback 
Vertex Set (where the requested solution is a subset of Q) can be reduced 
to an equivalent one where if there exists a solution, then the annotated set 
has at most c • k vertices. As (^^) = 2'-^^^\ the solution of the annotated 
version adds a 2^^^^ overhead to the 2^~^^ contribution of Step 5 which results 
to an 2*-^^'^) • -n? step algorithm. The technique we describe bellow is able to 
design FPT-algorthms for these three problems such as Feedback Vertex 
Set [901 [US], Directed Feedback Vertex Set Almost 2-SAT [2i8] . 
and Cluster Vertex Deletion |193j (see also the survey of Quo, H. Moser, 
and R. Niedermeier |184| on results using the iterative compression technique). 

Color-coding.. One of the most beautiful ideas in parameterized algorithm de- 
sign is Color-coding, introduced by Alon, Yuster, and Zwick in [18j. This 
technique was first applied to the following problem. 
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A:-Path 

Instance: A graph G and a non- negative integer k. 
Parameter: k. 

Question: Does G contain a path of at least k vertices? 

The above problem can be solved in 2*-^('^''°§'^) • n steps using dynamic pro- 



gramming techniques (see Subsection 4.3.1). However, an EPT-algorithm for 



this problem was highly welcome. The main reason for this is that it resolved 
the conjecture of Papadimitriou and Yannakakis who conjectured, in |245j . that 
it is possible to check in polynomial whether a n-vertex graph contains a path 
of length log n. 

The first step for solving A;-Path, is to consider a function x '■ ^(G) — )■ 
{1, . . . ,k} coloring the vertices of G with k distinct colors. Given a path P of 
G, we denote by col(P) the set of colors of the vertices in P. We cali a path 
P of G x-colorful, or simply colorful, if ali its colors are pairwise distinct. We 
also use the term i-path for a path of i vertices. We now define the following 
variant of the originai problem: 

fc- Colorful Path 

Instance: A graph G, a positive integer k, and a coloring x '■ ^(G) — {1, . . . , k}. 
Parameter: k. 

Question: Does G contain a colorful fc-path? 

fc-COLORFUL Path can be solved by the following dynamic programing 
procedure. First we fix a vertex s G V{G) and then for any v G V{G), and 
i G { 1 , . . . , A;} , we define 



Cs{i, v) = {R C {1, . . . , A;} I G has a colorful i-path P from 

s to w such that col(P) = R}. 

Notice that Cs{i-,v) stores sets of colors in paths of length i — 1 between s and 
V, instead of the paths themselves. Clearly, G has a colorful /c-path starting 
from s iff 3t> G y{G) : Cs(fc, v) ^ 0. The dynamic programming is based on the 
following relation: 

Cs{i,v)= U {R\R\{x{v)] ^Cs{i-iy)] 

Notice that \Cs{i,v)\ < (^) and, for ali v G V{G), Cs{i, v) can be computed in 
0(m • • i) steps (here, m is the number of edges in G). For ali v G V{G), 
one can compute Cs{k,v) in 0{Y^^^i fc'^ ' (i) " ^) ~ 0{2^ ■ k ■ m) steps. We 
conclude that one can check whether G colored by x has a colorful path of 
length k in 0{2^ ■ k ■ m ■ n) steps (just apply the above dynamic programming 
for each possible starting vertex s G V{G)). 
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A family of k-perfect hash functions is a family of functions from {1, . . . , n} 
Olito {1, . . . ,k} such that for each S C {1, . . . , n} with \S\ = k, there exists an 
X ^ J~ that is bijective when restricted to S. 

There is a lot of research on the construction of small size families of k- 
perfect hash functions dating back to the work of Fredman, J. Komlós, and 
E. Szemerédi p68] (see also |233[ 1261] I268J Ì. A construction of such a family 
of size n was given in [18]. However, the hidden Constant in the O- 

notation of this bound is quite big. Instead, we may use the recent results of 
Chen, Lu, Sze, and Zhang in [71] that give a family of /c-perfect hash functions 
J- where = 0(6.4'^ • n). Moreover, according to [71j, this collection can 
be constructed in 0(6.4'^ • n) steps. jTl] gives also lower bounds on the size 
of a family of /c-perfect hash functions indicating somehow the limits of the 
color-coding technique. 

Clearly G contains a fe-path if and only if there is a x G such that G, 
colored by Xì contains a x-colorful A:-path. This equivalence reduces the k- 
Path problem to the /c-Colorful Path problemi just run the above dynamic 
programming procedure for fc-COLORFUL Path for ali colorings in J^. As | = 
0(6.4^ • n), we conclude that /c-Pathg 0*(12.8*^)-FPT. 

Color-coding has been used extensively in parameterized algorithm design. 
Applications of the same technique can be found in [271 UOPI 11451 12181 I228| 
(see also [IH 11941 12631 1267j ). Also novel developments of the color-coding idea 
appeared recently in [T7 1 1162j . 

4-3.3. Subexponential algorithms 

Our next step is to deal with the classification of parameterized problems in 
the class SUBEPT. We present techniques that provide algorithms with subex- 
ponential parameter dependence for variants of parameterized problems where 
the inputs are restricted by some sparsity criterion. The most common re- 
striction for problems on graphs is to consider their planar variants where the 
input graph is embeddible in a sphere without crossings. As mentioned in The- 
orem 



3^91 in Subsection |3.6t A;-Planar Dominating Set does not belong to 
2°(v^) . n-FPT, unless M[l] = FPT and the same holds for several other prob- 
lems on planar graphs such as PLANAR Vertex Cover, Planar Indepen- 
DENT Set, Planar Dominating Set, and Planar Red/Blue Dominating 
Set [5_4j (see also |62u 66j). This implies that for these problems, when the spar- 
sity criterion includes planar graphs, the best running time we may expect is 
20{\/k) . Yi'^W ^ The first sub-exponential parameterized algorithm on planar 
graphs appeared by Alber, H. Bodlaender, Fernau, and Niedermeier in [U] for 
Dominating Set, Independent Dominating Set, and Face Cover. Af- 
ter that, many other problems were classified -FPT, while there 
was a considerable effort towards improving the Constant c for each one of 
them p IMI 1102 1 fTl9 l fT52 l fT65 l IMI l [207 1 Inn] 

Bidinensionality Theory was proposed in [96] as a meta-algorithmic frame- 
work that describes when such optimal subexponential FPT algorithms are pos- 
sible. Our first step is to illustrate the idea of bidimensionality for the following 
problem. 
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A:-Planar Longest Cycle 

Instance: A planar graph G and a nonnegative integer k. 
Parameter: k. 

Question: Does G contain a cycle of length at least k? 



We define the graph parameter le where 

lc(G) = min{A; | G does not contain a cycle of length at least k} 

Our subexponential algorithm for /c-Planar Longest Cycle will be based 
on the Win/win technique whose main combinatorial ingredient is the following 
result of Gu and Tamaki. 

Proposition 4.16 ^182] ). Every planar graph G where bw(G) > 3k contains 
a (k X k)-grid as a minor. 



Actually, Proposition 4.16 is an improvement of the result of Robertson, 
Seymour, and Thomas in |252| where the lower bound to branchwidth was 
originally ik instead of 3k. 

Notice that le is closed under taking of minors; the contraction/removal of 
an edge in a graph will not cause a bigger cycle to appear. This means that if 
G is a planar graph and lc(G) < none of the minors of G can contain a cycle 
of length As the (/ x /)-grid contains a cycle of length P, we conclude that G 



does not contain an {l x Z)-grid as a minor. From Proposition 4.16, bw(G) < 3L 
In other words, bw(G) < 3 • y^1c(G). 

To solve /c-Planar Longest Cycle we apply the following steps: 

(a) we compute an optimal branch decomposition of G. According to [181j . 
this can be done in O(n^) steps (the result in [ISlj is an improvement of 
the algorithm of Seymour and Thomas in |265j ). 

(b) we check whether bw(G) > 3^/k. If this is the case then lc(G) > k and 
we can safely return that G contains a cycle of length k. 

(c) if bw(G) < 3^/k, then we solve the following problem by using dynamic 
programming. 

òu;-Planar Longest Cycle 

Instance: A planar graph G and a non- negative integer /. 
Parameters: bw(G). 

Question: Does G contain a cycle of length at least /? 



What we bave done so far is to reduce the fc-PLANAR Longest Cycle to its 
bounded branchwidth counterpart. For general graphs, dynamic programming 
for this problem requires 0*(2'-^('^'°^'^)) steps. However, for planar graphs, one 
may use the technique introduced in |115j yielding a 2'^^'^^ ■ n'^^^^ step dynamic 
programming. In fact, according to [llOj . òu;-Planar Longest Cycle can be 
solved in 0{2'^-'^^'^^^^^ ■ n + n^) steps. We conclude that /c-Planar Longest 
Cycle belongs to 0(28-25-v^ . n + n3)-SUBEPT. 
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Notice that, in order to apply the above machinery, we made the following 
two observations on the parameter le: (1) it is closed under taking of minors 
and (2) its value with the (/ x /)-grid as input is i.e. a certificate of 

the solution for the ì-Planar Longest Cycle problem spreads along both 
dimensions of a square grid (i.e. it virtually spreads bidimensionally on the 
grid). These two observations apply to a wide range of parameters where the 
same approach can be used for the corresponding problems on planar graphs. 
Bidimensionality theory was introduced in [96] and used the above observations 
in order to derive subexponential algorithms for graphs embeddible in surfaces 
of bounded genus (see also |103j ). Later, the same theory was developed for 
parameters that are closed under contractions |158j and for classes of graphs 
excluding specific graphs as a minor [SU [99] . 

Consider the following parameterized meta-problem where C is a class of 
graphs. 



fc-PARAMETER ChECKING FOR p ON C 
Instance: a graph G £ C and an integer k > 0. 
Parameter: k 
Questioni p(G)< fc? 



Briefly, this theory can be summarized by the following meta-algorithmic 
framework. 

Theorem 4.17 (Minor bidimensionality |96t 199] ). Let Q he an H -minor free 
graph class. Let also p he a graph parameter which satisfies the following con- 
ditions: 

(i) p is minor closed, 

(ii) i/vlfc is the {k x k)-grid, then p(Afc) = r2(A;^), and 
(iii) for graphs in Q, p is computahle in time 2'^(''^('^)) • n^^^\ 
Then, A;-Parameter Checking por p on C belongs to 0*(2*^(^))-SUBEPT. 



Notice that Theorem 4.17 can be applied to maximization and minimization 
problems. We provide a typical example of its application on a maximization 
problem through /c-Path. Here, the associated parameter is 

p(G) = mm{k \ G does not contain a path of length k}. 

It is easy to check that conditions (i) and (ii) are satisfied. Indeed, no big- 
ger path occurs if we remove or contract an edge and the (k x /c)-grid has 
a (Hamiltonian) path of length k"^. Let Q be any //-minor free graph class. 
Condition (iii) holds for Q, because of the results in [113] . Therefore, /c-Path 
restricted to graphs in G belongs to 0*(2'^(^))-SUBEPT. 

Problems for which Theorem 4.17| proves SUBEPT-membership for graphs 
excluding some graph as a minor are /c-Vertex Cover, /c-Feedback Vertex 
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Set, /c-Almost Outerplanar, /c-Cycle Packing, /c-Path, A;-Cycle, k-d- 
Degree-Bounded Connected Subgraph, A:-Minimum Maximal Match- 
ING, and many others. 



We say that a graph H is a contraction of a graph G ìi H can be obtained 
from G after applying a (possibly empty) sequence of edge contraction^ A 
parameter p is contraction closed ìf H <c G implies that p{H) < p{G). 



Clearly, there are parameters escaping the apphcabihty of Theorem 4.17 



due to the fact that they are not minor-closed. The most typical example of 
such a parameter is the dominating set number: take a path P of length 3k and 
connect ah its vertices with a new vertex. Clearly, the resulting graph has a 
dominating set of size 1, while it contains P as a minor (actually it contains it 
as a subgraph) and every dominating set of P has size at least k. However, the 
dominating set number is contraction closed and the good news is that there 
is a counterpart of Theorem 4.17 for contraction closed parameters. Before we 
state this result, we need two more definitions. An apex graph is defined to 
be a graph that becomes planar after the removal of a vertex. A graph class 
G is apex-minor free if it is ff-minor free for some apex graph H. An apex- 
minor free graph can be seen as having some big enough "fiat region" , provided 
that the graph has big treewidth. Graph classes that are apex-minor free are 
the graph classes of bounded genus and the classes of graphs excluding some 
single-crossing graph as a minor |102j . 

The graph is the graph obtained from the {k x A;)-grid by triangulating 
internai faces of the {k x A:)-grid such that ali internai vertices become of degree 
6, ali non-corner external vertices are of degree 4, and one corner is joined by 
edges with ali vertices of the external face (the corners are the vertices that in 
the under lying grid have degree two). For the graph Fg, see Figure [2] 



Figure 2: The graph Te. 



Formally, the contraction relation occurs if in the definition of the minor relation (Sub- 
section 



4.2.21 we additionally demand that 



c) for every {x,y} G E{G), either (j){x) = (j}{y) or {(j}{x) , (t>{y)} G E{H). 
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Theorem 4.18 (Contraction bidimensionality |158j ). Let Q he an apex-minor 
free graph class. Let also p be a graph parameter which satisfies the foUowing 
conditions: 

(i) p is closed under contractions, 

(ii) p(rfe) = n{P), and 

(iii) for graphs in Q, p is computahle in time 2'^(''^('^)) • n^^^\ 

Then, fc-PARAMETER Checking for p ON C helongs to 0*(2*^(^))-SUBEPT. 



Problems for which Theorem 4.18 (but not Theorem 4.17) proves SUBEPT 



membership for apex-minor free graph classes are fc-DOMiNATiNG SET, k-i- 
DiSTANCE DOMINATING Set, /c-Face COVER (for planar graphs), /c-Edge 

DOMINATING SET, /c-CLIQUE-TRANSVERSAL SET, fe-CONNECTED DOMINATING 

SET, and others. 

For surveys on the appHcation of Bidimensionahty Theory on the design 
of sub-exponential parameterized algorithms, see 1114] (see [HE])- Finally, 
further apphcations of bidimensionahty, appeared in [971 11631 I164| I260j . Fi- 
nally, we should stress that bidimensionality is not the only technique to derive 
subexponential parameterized algorithms. Alternative approaches have been 
proposed in ^171 Hill IMI IMI 1270] . 

4.4- Kernelization 



Kernelization (see Definition 3.18 in Subsection 3.10) appears to be one of 
the most rapidly growing fields of parameterized computation. In this section 
we will describe some of the most characteristic techniques and results in this 
field. Ali kernels that we present are polynomial. We start with an easy case. 



4-4-1- easy example 

Consider the following problem. 



fc-NON-BLOCKER 

Instance: A graph G and an integer k > 1. 
Parameter: k 

Question: Does G contain a set S of at least k vertices such that each vertex 
in S has a neighbor that is not in S? 

A kernelization algorithm for the above problem runs as follows. The first 
step is to remove from G ali isolated vertices (clearly, they cannot be part of a 
solution). Then, in the remaining graph G', pick some vertex Vi from each of 
its connected components and define a partition of V{G) into two sets Vq and 
Vi such that Vq (resp. Vi) contains ali vertices of G' whose distance from some 
vertex Vi is even (resp. odd). W.l.o.g. we assume that |Vo| > \Vi\ (otherwise, 
swap their indices). If /c < |V()| then we know that Vq is a solution to the prob- 
lem and we return a YES-instance such as {K2, 1). Otherwise we return (G', k) 
that is a kernel whose graph has at most 2k — 2 vertices. 
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Currently the best known kernel for fc-NON-BLOCKER has size 5/3 ■ k |89j . 
We remark that the dual of the fe-NoN-BLOCKER problem is the sanie problem 
parameterized by k' = \ V{G) \ — k. This problem is equivalent to the DOMINAT- 
ING Set problem that is W[2]-complete and therefore the existence of a kernel 
for this problem is unlikely. 

In the above example the kernelization algorithm makes a very elementary 
preprocessing of the input. However, in other cases things are more complicated 
and the kernelization algorithm needs first to discard some parts or simplify the 
input in order to reduce it to an equivalent one of polynomial (on k) size. Our 
next example concerns a non-trivial case of this type. 

4-4-^- Simplifying structure 

We now proceed with an example where the construction of a kernel requires 
some more work. Consider the following problem: 

fc-3-DlMENSIONAL-MATCHING 

Instance: Three disjoint sets A,B,C, a collection of triples T A x B x C 
and an integer k > 1. 
Parameter: k 

Question: If there a subset C 7~ where \À4\ > k and such that no two triples 
in A4 share a common element (i.e. is a matching of T)? 

Let Ai' be a maximal matching of T- Clearly, such a matching can be found 
greedily in polynomial time. If \Ai'\ > k then we are done (in this case, return 
a trivial YES-instance). Therefore, we assume that \À4'\ < k — 1 and let S be 
the set of ali elements in the triples of Ai'. Certainly, |5| < 3A; — 3 and, by 
the maximality of A^', S will intersect every triple in T. Suppose now that 
T contains a sub-collection A with at least A; + 1 triples that agree in two of 
their coordinates. W.l.o.g. we assume that A = {{x,y,Vi) | i = 1 .../?} for 
some r > k + 1. Our first reduction rule is to replace (T, k) by (T', k) where 
T' = T \ {{x,y,Vi) I i = k + 1, . . . ,p}. We claim that this reduction rule is 
safe, i.e. the new instance (T', k) is equivalent to the old one. Obviously, every 
matching of T' is also a matching of T- Suppose now that is a matching of 
T that is not any more a matching of T' ■ Then we show that A4 can be safely 
replaced by another one that is in T' . Indeed, if Ai is not a matching of T' , 
then one of the triples in Ai is missing from T' and therefore is of the form 
T = (x, y, Vj) for some j € {k + 1, . . . , p}. Notice that if one of the triples in 
Ai \ {T} intersects a triple in {{x,y,Vi) \ i = 1 . . . k}, then this intersection will 
be a vertex in {vi \ i = 1, . . . , k}. As \A4 \ {T}\ < k, one, say T' of the k triples 
in {{x,y,Vi) I i = 1 . . .k} will not be intersected by the triples in A^ \ {T}. 
Therefore, Ai* = Ai \ {T} U {T'} is a matching of T' and the claim follows 
as \Ai*\ > k. Notice that the first rule simply "truncates" ali but k triples 
agreeing in the same two coordinates. 

We now assume that T is a collection of triples where no more than k 
of them agree in the same two coordinates. Suppose now that T contains 
a sub-collection B with more than 2{k — l)k + 1 triples, ali agreeing to one 
coordinate. W.l.o.g. we assume that the agreeing coordinate is the first one. 
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The second reduction rule removes from T ali but 2{k — l)k + 1 of the elements 
of B. Again using a pigeonhole argument, it follows that in the 2{k — l)k + 1 
surviving triples of B there is a subset C oi 2k — \ triples where each two of 
them disagree in both second and third coordinate. Again, if a discarded triple 
is used in a solution A^, then the k — 1 other triples cannot intersect more 
than 2k — 2 triples of C and therefore a "surviving" one can substitute the 
discarded one in Ai. Therefore, the second truncation is also safe and leaves an 
equivalent instance T' where no more than 2{k — l)k + 1 of them agree in the 
same coordinate. Recali now that the elements of the set S intersect ali triples 
in T- As |5| < 3{k — 1), we obtain that, in the equivalent instance {T',k), 
V has at most 3{k - 1) • {2{k - l)k + 1) = 0{k^) triples. We conclude that 
P-3-Dimensional-Matching has a polynomial size kernel. 

The above kernelization was proposed by Fellows, Knauer, Nishimura, Ragde, 
Rosamond, Stege, Thilikos, and Whitesides in |145j and, combined with the 
color coding technique, gave algorithms of total complexity 2'^^'^^ + 0{n) for 
a wide variety of packing and matching problems. For other related results, 
see [HI 1631 fTM [2261 [2T7] . 

4-4- 3- Superoptimality in Integer Programming 

Perhaps the first appearance of the kernelization idea can be traced to the 
work of Nemhauser and Trotter for Vertex Cover [234J . It leads to a kernel of 
size 2k and it was proposed as an alternative way to obtain a 2-approximation 
for the vertex cover of a graph. To explain the idea of this kernelization we 
need to express the problem as an integer programming problemi 

minimize J2veV{G) subject to 

^{v,u}eE{G) Xy+Xu>l 

'^veViG) < < 1 

Any integer solution to the above problem assigns, for each v € V{G), an integer 
value from {0, 1} to the corresponding variable x^j and yields to a solution to 
the Vertex Cover problem. When we relax the problem so that the variables 
lie in the real interval [0, 1] the resulting LP can be solved in polynomial time. 
Moreover, the value of the optimal LP solution is clearly a lower bound on the 
minimum size of a vertex cover. However, these solutions do not represent any 
more an actual solution to the vertex cover problem. In |234j . it was proved 
that every real solution can be transformed, in polynomial time, to a half-integer 
one where for each v G V{G), Xy E {0, 1}. Such a, stili non-integer, solution 
defìnes a partition of V{G) into three sets Vq, Vi, and Vi. As shown in j234j 
(see also [78]), these sets satisfy the following properties: 

(1) (approximability) iVi 1 < 2 • vc(G[Vi]). 

2 2 

(2) (Super-optimality) every minimum vertex cover 5 of G satisfies Vi C 5 C 

ViUVi 

2 
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Observe that no edges in G have both endpoints in Vb or one endpoint in 
Vo and the other in Vi. This fact, together with property (2), implies that if S 

2 

is an optimal solution, then S \ Vi Vi and 5 \ 14 is a vertex cover of G[Vi]. 
Therefore vc(G) > vc(G[Vi]) + |Vi|. Moreover, if Si is a vertex cover of GfVi], 

2 2 2 

then SiUVi is a vertex cover of G, which impUes that vc(G) < vc(G[Vil) + |Vi|. 

2 2 

We conclude that: 

vc(G) = vc(G[Vi]) + 

The above relation reduces the problem of computing vc(G) to the one of com- 
puting vc(G[V"i]). Recali that, from Property (1), \Vi\/2 < vc(G[yi]) < iVi]. 
Therefore, the size of Vi is a 2-approximation of vc(G[Viì) and thus iVi 1 + 

2 2 2 

is a 2-approximation of vc(G). However, this type of approximation provides 
also a kernel of size 2k for Vertex Cover as follows. We first compute, in 
polynomial time. Vi and Vi and we ask whether 1 Vi 1 < 2(A; — 1 Vi 1 ) . If the answer 

2 2 

is negative, then, again from Property (1), we have that vc(G[Vi]) > k — \Vi\. 
This implies that vc(G) > k and we can safely report that G has no vertex 
cover of size < k or, more formally, just return a NO-instance such as {K2,0). 
If iVil < 2(k — \ Vi\) then we output (GfìAl, k — \ Vi\) as an equivalent instance 

2 2 

whose graph has size at most 2k. 

A naturai question is whether it is possible to produce a linear kernel of 
c • k vertices for some c < 2. Notice that any such kernel would imply a "better 
than two" approximation for the Vertex Cover. 



As mentioned in Subsection 3.10 the non-approximability results of [107] 
imply that we cannot expect a kernel with less than 1.36A; vertices for Vertex 
Cover. Better lower bounds can be derived for the case of Planar Vertex 
Cover. Using a technique developed in [63], it follows easily that, for every 

'4 
^3 



e > 0, there is no kernel with a planar graph of size {i — e) ■ k for this problem, 



unless P=NP. 

An intriguing question is to prove the existence of a polynomial kernel for 
the following meta-problem. 



fe-DiSTANCE from i^-MINOR FREE 
Instance: A graph G and an integer k > 1. 
Parameter: k 

Question: Does G contain a subset 5 of at most k vertices such that G — S 
does not contain H as a, minor? 



Clearly, the above problem is Vertex Cover when H = K2 and Feed- 
back Vertex Set when H = and these are the only two cases where a 
polynomial kernel is known. Actually, the research on a kernel for the Feed- 
back Vertex Set was quite extended (see (SU 08]) and the best up to now 
result is the 0{k'^) kernel provided by Thomassé in |275j . Recently, a poly- 
nomial kernel was devised for the case where H is the Qc graph, that is two 
vertices connected with c parallel edges |161j . For more general cases of H the 
problem remains open. 
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4 -4 -4- Extremal combinatorics 

Many polynomial kernels make strong use of results in extremal graph the- 
ory. An easy, though characteristic, example is the following problem: 

k-MAX Leaf 

Instance: A connected graph G and an integer A; > 1. 
Parameter: k 

Question: Does G contain a spanning tree with at least k leaves? 

The above problem is NP-complete pi 7J . A kernel of at most 8k vertices for 
this problem is the procedure that repetitively applies the following reduction 
rules until none of them applies more: 

RI: If G contains a vertex v of degree 1 with a neighbor of degree 2 then set 
{G,k)^{G\{v},k). 

R2: If G contains two vertices v and v' of degree 1 with the same neighbor, 
then set (G, k) ^ {G\{v},k - l). 

R3: If G contains a chain of length at least 4 then set {G, k) ^ [G\ k) where 
G' is the graph obtained if we contract some of the edges of this chain. 
(A chain is a path of length at least 2, where ali internai vertices have 
degree 2, and with endpoints of degree greater than 2.) 

It is not hard to see that ali rules above are producing (simpler) equivalent 
instances. A reduced instance {G' , k'), is an instance of the problem where none 
of the above rules can be applied any more. What remains to prove is that 
if in a reduced instance {G',k'), G' has least 8k' vertices, then {G',k') is a 
NO-instance. 

We denote by Vi, V2, and V>3 the set of vertices of G' with degrees 1, 2, or 

> 3 respectively. Because of the first rule, vertices in Vi are adjacent only with 
vertices in V3 and, from the second rule, we have that |Vi| < IV3I. Moreover, 
from the third rule, ali the chains of G' have length at most 3. 

We aim to prove that if > 8A;', then G' contains a spanning tree of 

k' leaves. For this, we construct, using G' , an auxiliary graph H by removing 
ali vertices of degree 1 and by replacing ali chains of G' by chains of length 2. 
Notice that H does not have vertices of degree 1 and ali its vertices of degree 
2 - we cali them subdivision vertices - are internai vertices of some chain of 
length 2. We denote by Q2 and Q>3 the vertices of H that have degree 2 or 

> 3 respectively. Notice that I^SsI = |Q>3| which, combined with the fact 
that < IV3I, implies that + |V>3| < 2 • |<5>3|. Moreover, each vertex 
in Q2 corresponds to at most two vertices of ¥2- Therefore IV2I <2-\Q2\. We 
conclude that \V{G')\ = l^il + 1^2! + I^SsI < 2 • IQal + 2 • |g>3| = 2 • As 
\V{G')\ > 8k', we conclude that \V{H)\ > Ak' . We cali two subdivided edges of 
H siblings if they have the same neighborhood. We add edges between siblings 
so that H is transformed to a graph H' with minimum degree 3. It is easy 
to see that if H' contains a spanning tree with at least k' leaves then also H 
contains a spanning tree with at least k' leaves. As > 4A:', then from 
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the mail! result of Kleitman and West in [206j we have that H' (and therefore 
H) contains a spanning tree of with least k' leaves. By the construction of H, 
it easily follows that this spanning tree of H can be extended to a spanning 
tree in G' with at least the same number of leaves and we are done. 

Clearly, the correctness of the above kernel is based on the combinatorial 
result of |206j . By using more reduction rules and more refined arguments it 
is possible to construct even better kernels for A;-Max Leaf. For instance, 
in |139j Estivill-Castro, Fellows, Langston, and Rosamond give a 3.75 • k kernel 
for this problem. Notice that the parameterized complexity of the problem 
changes drastically if we ask for a spanning tree with at most k leaves. Even for 
k = 2, this is an NP-complete problem. Therefore there is no n^^^^ algorithm 
for this parametrization, unless P = NP. 

4-4-5. Kernels for sparse graphs 

Clearly, one cannot expect that a kernel exists for a problem that is hard 
for some level of the W-hierarchy. However, such problems may become fixed 
parameter tractable when their instances are restricted to sparse structures. In 
case of graph-theoretic problems such a sparsity criterion is usually planarity 
or the exclusion of certain types of graphs as a minor. The prototype of such 
a problem was Planar Dominating Set that, as we mentioned in Subsec- 
tion 14.3.3 belongs to SUBFPT. The first kernel for this problem was given by 



the celebrated result of Alber, Fellows, and Niedermeier in ^llj and was of size 
335A;. The kernel of [11] is using the fact that the sphere in which the input 
graph is embedded, can be decomposed into a set of 0{k) regions such that each 
vertex inside a region is in the neighborhood of its boundary vertices. This last 
property, makes it possible to apply a suitable reduction in each region and re- 
duce its vertices to a Constant size. Because of planarity, there are 0{k) regions 
in total and this implies the existence of a linear kernel. Based on the same idea 
and a more refined analysis, this kernel was improved to one of size 67k in |63j . 
The idea of a region decomposition was further extended in \186\ for several 
problems such as Connected Vertex Cover, Minimum Edge Dominat- 
ing Set, Maximum Triangle Packing, and Efficient Dominating Set 
on planar graphs. While in ali the above results the reduction rules were partic- 
ular for each problem, it appeared that the whole idea can be vastly extended 
to a general meta-algorithmic framework that we will describe in the rest of 
this section. 

The compactness condition.. Let Gg be the family of ali graphs that can be 
embedded in a surface S of Euler-genus at most g. Given a graph G embedded 
in a surface E of Euler-genus g, and a set S, we define Rg(5') to be the set 
of ali vertices of G whose radiai distance from some vertex of S is at most 
r. The radiai distance between two vertices x,y is the minimum length of an 
alternating sequence of vertices and faces starting from x and ending in y, such 
that every two consecutive elements of this sequence are incident to each other. 

We consider parameterized problems where II C x N, i.e. we impose 
bounded genus as a promise condition. We say that a parameterized problem 
n C X N is compact if there exists an integer r such that for ali (G = 
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{V,E),k) £ n, there is an embedding of G in a surface S of Euler-genus at 
most g and a set 5 C y such that \S\ < r-k and Rg.(5) = V. The compactness 
condition is what makes it possible to construct a region decomposition for the 
instances of a parameterized problem. The region decomposition is constructed 
on the surface where the input graph is embedded. For the automation of the 
reduction rules that are apphed in the regions we demand the expressibihty of 
the problem by a certain logie. 

Counting Monadic Second Order Logic. Counting Monadic Second-Order Logic 



(CMSOL) is an extension of MSOL defined in Subsection 4.2.2 where, in ad- 
dition to the usuai features of monadic second-order logie, we have atomic 
formulas testing whether the cardinality of a set is equal to n modulo p, where 
n and p are integers such that < n < p and p > 2 (see |2Tl EU EI])- So 
essentially CMSOL is MSOL with atomic formulas of the following type: 

If U denotes a set X, then card„^p(C/) = true if and only if \X\ is 
n mod p. 

In a A;-MiN-CMSOL parameterized graph problem LI C x N, we are 
given a graph G = {V,E) and an integer k as input. The objective is to 
decide whether there is a vertex/edge set S of size at most k such that the 
CMSOL-expressible predicate Pn{G, S) is satisfied. The annotated version LI" 
of a fc-MiN/EQ/MAX-CMSOL problem LI is defined as follows. The input is a 
triple {G = (V, E),Y, k) where G is a graph, y C y is a set of black vertices, 
and fc is a non-negative integer. In the annotated version of a fc-MiN-CMSOL 
graph problem, S is additionally required to be a subset of Y. Finally, for 
a parameterized problem LI C x N, let LI C x N denote the set of ali 
no-instances of LI. 

Kernelization meta-theorems. . The first meta-algorithmic results on kernels ap- 
peared by Bodlaender, Fomin, Lokshtanov, Penninkx, Saurabh, and Thilikos 
in [32] and by Fomin, Lokshtanov, Saurabh, and Thilikos in |164j . As a sample, 
we present the following one: 

Theorem 4.19 (32]). Let U (1 Gg x N be an NP-complete /c-min-CMSOL 
parameterized problem such that either LI or LI is compact and LI" is in NP . 
Then LI admits a polynomial kernel. 

The above theorem is essentially a corollary of the fact, proven in [32], 
that if n C X N is a /c-min-CMSOL parameterized problem and either 
n or n is compact, then its annotated version LI" admits a quadratic kernel. 
Another condition that, together with the compactness condidtion, allows the 
derivation of a linear kernel for a A;-min-CMSOL parameterized problem is the 
one having finite integer index, introduced in [44J. This condition, combined 



with bidimensionality theory (presented in Subsection 4.3.3) was used in [164j 
in order to derive kernelization meta-theorems for more general graph classes, 
namely classes excluding some graph (apex or general) as a minor. 



Theorem 4.19 immediately implies the existence of polynomial kernels for a 
wide family of problems. However, the potential of this type of meta-algorithmic 
results has not been fully investigated yet. 
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We conclude our kernelization subsection by mentioning that it cannot be 
more than incomplete. For a small sample of recent resulta on the existence of 
polynomial kernels for several parameterized problems, see [HI [121 [MI E21 EU 
[8m[92l fT6TlfT871fTMmfT971[2T2l[236] . 

4.5. (Much) more on parameterized algorithms 

Certainly, there are many issues on parameterized algorithm design that are 
not (and cannot be) covered here. Among them, we should mention parame- 
terized algorithms for counting problems |10H 11041 11531 12271 12431 1276j , param- 
eterized approximation [221 IZZl IH^l 11291 H^^l I224| , and parameterized paral- 
lelization [59] . Also we should mention that new powerful techniques emerge 
quite rapidly in parameterized algorithm design, such as the use of important 
seprators for the FPT-algorithm proposed for the /c-Edge Multicut and the 
/c-Vertex Multicut problems by Daniel Marx and Igor Razgon in [225] (see 
also US]). 

Acknowledgements. Many thanks to Mike Fellows, Fedor V. Fomin, Bart M. 
P. Jansen, Stavros G. Kolliopoulos, Moritz Mùller, Saket Saurabh, and Geoff 
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